-- Logs begin at Tue 2022-09-06 03:44:02 UTC, end at Tue 2022-09-06 05:02:35 UTC. -- Sep 06 04:26:46.819024 dv-cinder-856002-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 04:26:46.826501 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 04:26:46.828483 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 04:26:46 2022] *** Sep 06 04:26:46.828483 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 04:26:46.828483 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 04:26:46.828483 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: nodename: dv-cinder-856002-1-iscsi Sep 06 04:26:46.828483 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: machine: x86_64 Sep 06 04:26:46.828483 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: clock source: unix Sep 06 04:26:46.828483 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: pcre jit disabled Sep 06 04:26:46.828974 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: detected number of CPU cores: 4 Sep 06 04:26:46.828974 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: current working directory: / Sep 06 04:26:46.828974 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: detected binary path: /usr/bin/uwsgi-core Sep 06 04:26:46.828974 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: your processes number limit is 47680 Sep 06 04:26:46.828974 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: your memory page size is 4096 bytes Sep 06 04:26:46.828974 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: detected max file descriptor number: 2048 Sep 06 04:26:46.828974 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: lock engine: pthread robust mutexes Sep 06 04:26:46.828974 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: thunder lock: enabled Sep 06 04:26:46.828974 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 04:26:46.828974 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 04:26:46.870030 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: Python main interpreter initialized at 0x55b34f7879c0 Sep 06 04:26:46.870030 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: python threads support enabled Sep 06 04:26:46.870030 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: your server socket listen backlog is limited to 100 connections Sep 06 04:26:46.870030 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: your mercy for graceful operations on workers is 90 seconds Sep 06 04:26:46.870413 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 04:26:46.870491 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: *** Operational MODE: preforking *** Sep 06 04:26:46.870744 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: *** uWSGI is running in multiple interpreter mode *** Sep 06 04:26:46.870744 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: spawned uWSGI master process (pid: 106152) Sep 06 04:26:46.870940 dv-cinder-856002-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 04:26:46.871496 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: spawned uWSGI worker 1 (pid: 106153, cores: 1) Sep 06 04:26:46.871835 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: spawned uWSGI worker 2 (pid: 106154, cores: 1) Sep 06 04:26:46.871993 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 04:26:47.531861 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 04:26:47.537661 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 04:26:48.609794 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 04:26:48.609794 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: from cryptography.utils import int_from_bytes Sep 06 04:26:48.610403 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 04:26:48.610403 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: from cryptography.utils import int_from_bytes Sep 06 04:26:48.615160 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 04:26:48.615160 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: from cryptography.utils import int_from_bytes Sep 06 04:26:48.615586 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 04:26:48.615586 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: from cryptography.utils import int_from_bytes Sep 06 04:26:51.182500 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 04:26:51.183151 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 04:26:51.183282 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 04:26:51.183646 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 04:26:51.183903 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 04:26:51.184293 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.184624 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.184948 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.185269 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.185628 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.185944 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.186284 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.186590 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.186919 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.187182 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.187502 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.187830 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856002-1-iscsi {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.188154 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.188469 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.188784 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.189103 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.189438 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.189763 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.190073 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.190566 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.191693 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.192135 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.192460 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.192806 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.193128 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.193468 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.193798 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.194112 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.194440 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.194754 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.195152 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856002-1-iscsi {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.195470 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.195787 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.196107 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.196520 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.196832 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.197144 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.197493 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.197819 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.198129 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.198471 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.198793 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.199117 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.199435 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.199741 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.200047 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.200359 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.200678 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.200983 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.201288 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.201563 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.201874 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.202196 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.202520 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.202845 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.202967 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 04:26:51.203356 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.203441 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 04:26:51.203520 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.203643 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.203728 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 04:26:51.203964 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.204086 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 04:26:51.204274 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.204369 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 04:26:51.204583 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.204712 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.204891 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.205038 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.205199 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.205379 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.205533 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.205700 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.205843 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.206030 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.206152 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.206343 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.206516 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.206684 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.207004 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.207088 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.207331 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.207419 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.207592 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.207727 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.207907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.208044 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.208235 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856002-1-iscsi {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.208378 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.208556 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.208781 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.208874 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.209035 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.209156 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.209371 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.209502 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.209722 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.209830 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.210046 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.210159 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.210360 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.210463 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.210683 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.210892 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.211008 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.211200 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.211296 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.211504 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.211598 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.211813 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.211924 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.212148 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.212250 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.212459 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.212573 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.212767 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.212873 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.213058 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.213160 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.213400 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.213495 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.213726 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.213827 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.214035 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.214121 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.214366 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.214450 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856002-1-iscsi {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.214676 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.214768 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.214984 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.215070 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.215287 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.215372 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.215596 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.215715 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.215906 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.216044 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.216215 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.216335 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.216527 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.216640 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.216835 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.216973 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.217144 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.217280 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.217475 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.217628 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.217783 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.217955 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.218091 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.218275 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.218405 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.218594 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.218724 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.218897 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.219045 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.219205 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.219355 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.219513 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.219660 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.219835 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.219970 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.220140 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.220278 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.220445 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.220598 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.220693 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.220905 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.221000 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.221212 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.221298 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.221558 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.221657 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.221865 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.221959 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.222307 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.222397 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.222602 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.222870 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.222977 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.223244 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.223409 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.223557 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.223868 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.223982 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.224177 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.224486 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.224572 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.224928 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.225022 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.225268 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.225399 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.225602 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.225695 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.225911 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.225999 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.226233 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.226318 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.226548 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.226700 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.226862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.226947 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.227167 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.227250 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.227479 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.227564 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.227790 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.227890 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.228100 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.228196 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.228410 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.228504 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.228730 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.228813 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.229055 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.229145 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.229402 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.229551 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.229706 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.229792 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.230017 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.230103 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.230324 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.230483 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.230630 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.230715 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.230936 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.231028 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.231254 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.231348 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.231588 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.231684 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.231892 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.231987 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.232143 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.232266 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.232442 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.232587 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.232745 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.232902 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.233062 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.233221 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.233391 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.233574 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.233700 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.233890 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.233993 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.234206 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.234292 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.234519 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.234605 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.234838 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.234933 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.235160 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.235244 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.235462 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.235554 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.235769 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.235856 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.236074 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.236167 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.236377 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.236461 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.236682 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.236807 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.236986 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.237078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.237289 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.237408 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.238149 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.238251 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.238509 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.238775 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.238860 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.239113 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.239225 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.239454 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.239557 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.239752 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.239840 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.240072 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.240166 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.240377 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.240463 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.240682 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.240766 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.241002 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.241096 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.241349 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.241439 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.241636 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.241722 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.241953 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.242040 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.242259 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.242351 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.242564 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.242650 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.242882 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.242975 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.243181 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.243267 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.243486 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.243571 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.243801 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.243894 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.244106 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.244191 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.244410 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.244505 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.244712 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.244798 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.245014 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.245100 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.245330 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.245434 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.245641 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.245735 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.245943 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.246027 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.246245 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.246330 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.246545 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.246640 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.246860 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.246945 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.247179 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.247264 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.247486 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.247573 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.247790 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.247874 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.248093 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.248192 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.248398 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.248483 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:26:51.248711 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.248804 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.249025 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.249118 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.249370 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.249472 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.249705 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.249838 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.250019 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.250113 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.250351 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.250439 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.250660 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.250743 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.250969 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.251069 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.251279 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.251365 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.251594 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.251678 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.251901 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.251986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.252211 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.252296 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.252521 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.252613 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.252829 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.252916 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.253143 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.253241 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.254063 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.254162 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.254383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.254686 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.254777 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.255004 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.255088 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.255315 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.255409 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.255637 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.255722 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.255962 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.256048 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.256279 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.256365 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.256591 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.256676 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.256909 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.257043 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.257225 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.257334 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.257581 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.257670 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.257900 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.257992 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.258216 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.258303 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.258525 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.258609 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.258837 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.258933 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.259147 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.259242 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.259490 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.259576 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.259802 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.259946 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.260113 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.260206 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.260418 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.260504 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.260726 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.260827 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.261032 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.261125 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.261361 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.261463 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.261673 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.261768 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.261980 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.262072 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.262283 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.262368 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.262589 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.262688 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.262896 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.262980 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.263206 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.263295 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.263513 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.263599 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.263829 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.263914 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.264138 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.264232 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.264447 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.264533 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.264752 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.265095 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.265320 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.265407 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.265640 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.265727 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.265945 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.266030 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.266248 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.266333 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.266553 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.266677 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.266862 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.266947 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.267167 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.267261 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.267486 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.267571 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.267812 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.267905 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.268119 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.268213 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.268442 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.268526 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.268748 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.268842 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.269150 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.269281 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.269483 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.269796 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.269934 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.270104 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.270190 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.270417 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.270503 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.270727 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.270811 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.271034 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.271129 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.271356 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.271441 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.271665 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.271749 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.271969 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.272063 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.272286 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.272369 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.272589 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.272673 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.272896 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.272990 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.273214 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.273425 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.273548 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.273648 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.273859 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.273955 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.274173 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.274259 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.274483 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.274568 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.274802 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.274894 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.275111 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.275196 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.275422 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.275506 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.275743 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.275830 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.276054 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.276139 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.276360 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.276443 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.276673 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.276797 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.276993 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.277077 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.277321 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.277420 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.277627 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.277713 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.277936 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.278031 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.278248 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.278332 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.278551 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.278644 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.278856 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.278941 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.279165 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.279259 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.279467 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.279552 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.279773 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.279859 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.280077 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.280172 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.280384 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.280531 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.280688 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.280810 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.281003 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.281265 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.282450 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.282584 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.282721 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.282857 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.283000 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.283149 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.283284 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.283445 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.283445 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.283445 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.283445 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.283816 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.283895 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.283973 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.284049 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.284132 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.284348 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.284444 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.284754 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.284910 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.285071 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.285409 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.285523 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.285725 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.285819 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.286038 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.286125 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.286351 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.286509 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.286672 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.286757 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.286985 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.287081 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.287293 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.287422 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.287602 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.287696 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.287922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.288006 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.288234 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.288327 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.288542 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.288627 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.288844 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.288928 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.289149 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.289243 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.289508 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.289595 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.289829 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.289912 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.290137 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.290231 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.290455 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.290562 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.290771 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.290878 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.291078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.291170 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.291384 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.291468 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.291693 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.291787 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.292001 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.292087 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.292308 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.292400 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.292625 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.292719 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.292932 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.293016 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.293247 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.293365 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.293580 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.293674 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.293897 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.293980 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.294201 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.294287 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.294519 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.294615 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.294825 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.294910 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.295137 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.295227 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.295452 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.295539 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.295759 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.295844 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.296073 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.296157 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.296467 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.296702 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.296954 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.297047 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.297294 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.297709 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.297709 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.297859 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.297937 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.298011 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.298218 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.298334 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.298524 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.298620 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.298839 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.298925 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.299151 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.299237 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.299461 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.299548 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.299768 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.299852 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.300083 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.300703 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.300920 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.301111 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.301225 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.301538 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.301630 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.314628 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.314724 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.314792 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.314857 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.314934 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.315011 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.315011 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.315174 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.315252 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.315329 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.315329 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.315469 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.315555 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.315642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.315642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.315867 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.315867 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316028 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316095 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316159 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316222 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316286 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316349 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316425 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316425 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316557 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316557 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316673 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316749 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316834 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316913 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316990 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.316990 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.317117 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.317245 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.317379 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.317379 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.317536 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.317621 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.317743 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.317837 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.317918 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.317996 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.318080 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.318158 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.318235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.318320 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.318400 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.318477 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.318562 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.318641 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.318719 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.318803 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.318882 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.318958 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.319035 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.319112 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.319189 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.319344 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.319425 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.319502 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.319586 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.319671 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.319763 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.319842 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.319918 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.319994 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.320077 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.320155 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.320245 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.320245 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.320405 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.320484 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.320561 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.320644 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.320739 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.320825 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.320904 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.320970 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.321060 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.321159 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.321248 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.321434 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.321528 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.321595 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.321672 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.321757 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.321843 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.321934 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.322014 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.322098 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.322176 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.322253 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.322329 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.322414 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.322492 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.322492 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.322642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.322709 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.322781 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.322846 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.322918 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.322996 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.323073 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.323150 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.323235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.323321 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.323406 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.323535 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.323617 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.323694 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.323786 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.323869 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.323947 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.324024 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.324100 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.324184 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.324275 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.324355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.324433 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.324516 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.324648 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.324786 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.324871 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.324955 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.325034 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.325122 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.325201 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.325291 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.325402 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.325482 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.325559 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.325635 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.325712 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.325801 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.325880 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.325964 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.326043 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.326120 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.326203 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.326294 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.326374 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.326451 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.326528 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.326604 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.326689 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.326774 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.326853 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.326929 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.327006 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.327082 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.327167 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.327252 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.327372 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.327457 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.327542 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.327620 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.327706 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.327785 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.327851 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.327915 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.327991 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.328140 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.328231 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.328311 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.328395 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.328474 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.328474 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.328622 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.328701 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.328778 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.328854 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.328931 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.329007 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.329096 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.329175 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.329252 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.329356 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.329449 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.329517 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.329590 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.329676 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.329755 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.329831 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.329908 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.329991 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.330192 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.330289 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.330511 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.330599 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.330820 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.330920 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.331128 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.331217 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.331976 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.332074 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.332279 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.332550 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.332688 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.332884 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.332968 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.333185 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.333273 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.333534 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.333624 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.333845 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.333930 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.334151 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.334245 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.334456 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.334543 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.334766 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.334860 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.335070 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.335169 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.335375 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.335461 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.335686 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.335771 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.336002 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.336098 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.336315 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.336400 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.336618 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.336706 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.336926 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.337083 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.337231 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.337337 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.337557 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.337646 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.337862 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.337966 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.338172 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.338257 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.338472 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.338556 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.338780 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.338874 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.339083 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.339199 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.339385 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.339479 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.339687 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.339774 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.339993 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.340078 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.340303 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.340387 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.340607 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.340694 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.340910 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.341035 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.341213 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.341360 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.341578 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.341676 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.341881 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.341985 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.342241 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.342339 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.342549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.342636 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.342863 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.342945 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.343179 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.343286 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.343486 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.343572 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.343795 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.343908 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.344108 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.344207 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.344412 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.344523 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.344726 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.344839 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.345034 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.345150 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.345377 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.345468 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.345682 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.345770 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.345985 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.346099 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.346304 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.346402 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.346617 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.346703 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.346927 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.347111 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.347880 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.348047 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.348205 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.348292 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.348531 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.348618 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.348836 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.348997 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.349145 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.349325 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.349484 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.349655 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.349792 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.350076 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.350163 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.350393 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.350480 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.350701 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.350794 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.351012 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.351099 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.351324 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.351411 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.351634 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.351720 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.351943 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.352033 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.352250 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.352351 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.352559 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.352653 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.352865 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.352951 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.353171 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.353257 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.353520 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.353608 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.353830 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.353978 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.354115 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.354251 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.354426 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.354570 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.354731 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.354872 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.355039 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.355177 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.355329 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.355465 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.355755 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.355897 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.356067 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.356200 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.356379 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.356510 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.356684 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.356825 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.356994 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.357126 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.357322 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.357467 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.357634 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.357796 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.357946 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.358085 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.358238 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.358370 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.358543 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.358674 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.358871 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.359004 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.359178 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.359321 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.359493 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.359626 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.359806 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.359945 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.360115 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.360255 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.360426 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.360559 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.360732 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.360864 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.361047 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.361162 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.361402 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.361500 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.361675 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.361767 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.362002 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.362091 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.362309 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.362421 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.362653 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.362757 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.363205 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.363303 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.363450 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.363609 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.363753 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.363930 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.365370 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.365556 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.365725 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.365888 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.366037 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.366192 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.366338 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.366471 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.366606 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.366761 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.366900 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.367044 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.367180 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.367322 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.367467 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.367602 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.367735 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.367871 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.368001 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.368084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.368173 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.368253 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.368331 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.368415 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.368495 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.368580 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.368669 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.368756 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.368835 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.368913 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.368991 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.369076 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.369167 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.369247 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.369507 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.369595 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.369816 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.369972 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.370122 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.370297 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.370433 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.370612 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.370757 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.370939 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.371038 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.371264 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.371362 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.371572 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.371665 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.371877 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.371964 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.372188 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.372274 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.372495 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.372581 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.372801 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.372888 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.373128 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.373221 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.373478 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.373587 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.373793 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.373931 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.374106 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.374200 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.374415 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.374510 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.374721 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.374815 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.375026 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.375113 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.375348 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.375443 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.375653 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.375739 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.375971 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.376055 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.376282 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.376377 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.376598 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.376682 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.376917 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.377002 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.377220 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.377383 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.377564 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.377650 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.377873 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.377960 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.378180 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.378305 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.380677 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.380825 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.380936 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.381051 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.381168 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.381285 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.381422 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.381422 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.381637 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.381637 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.381840 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.381946 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.382049 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.382153 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.382256 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.382368 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.382474 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.382701 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.382789 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.382869 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.382956 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.383044 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.383123 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.383201 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.383201 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.383342 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.383469 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.383594 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.383677 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.383677 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.383826 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.383997 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.384160 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.384301 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.384595 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.384729 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.384925 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.385135 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.385281 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.385550 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.385652 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.385936 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.386022 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.386248 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.386479 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.386624 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.386876 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.386961 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.387195 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.387397 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.387522 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.387841 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.387928 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.388158 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.388343 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.388475 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.388789 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.388878 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.389103 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.389362 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.389468 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.389750 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.390141 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.390340 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.390614 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.390700 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.390990 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.391077 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.391309 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.391511 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.391626 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.391945 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.392032 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.392455 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.392548 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.392776 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.392964 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.393112 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.393477 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.393570 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.393798 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.394500 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.394816 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.395096 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.395235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.395469 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.395559 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.395816 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.395959 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.396128 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.396445 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.396532 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.396761 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.396926 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.397069 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.397421 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.397524 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.397739 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.397913 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.398049 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.398374 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.398463 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.398688 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.398861 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.399224 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.399347 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.399576 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.399841 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.399928 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.400212 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.400547 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.400641 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.400868 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.401149 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.401236 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.401517 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.401658 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.401832 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.402143 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.402231 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.402462 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.402623 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.402861 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.403073 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.403162 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.403382 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.403570 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.403728 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.404013 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.404170 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.404309 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.404513 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.404649 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.404915 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.405011 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.405247 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.405480 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.405651 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.405961 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.406060 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.406270 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.406454 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.406585 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.406894 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.406980 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.407204 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.407443 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.407540 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.407808 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.407927 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.408123 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.408409 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.408497 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.408735 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.408894 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.409041 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.409378 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.409512 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.410394 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.410635 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.410982 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.411188 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.411307 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.411640 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.411728 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.411954 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.412257 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.412343 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.412579 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.412805 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.412935 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.413213 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.413377 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.413569 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.413887 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.413989 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.414238 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.414461 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.414548 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.415035 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.415140 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.415407 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.415604 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.415735 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.416075 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.416159 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.416458 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.416653 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.416782 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.417106 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.417192 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.417463 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.417757 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.417844 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.418123 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.418300 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.418443 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.418783 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.418912 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.419089 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.419413 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.419628 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.419948 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.420047 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.420297 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.420509 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.420628 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.420957 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.421058 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.421280 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.421626 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.421713 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.421959 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.422186 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.422286 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.422566 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.422739 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.422880 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.423196 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.423292 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.423502 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.423817 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.423950 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.424127 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.424367 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.424455 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.424743 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.424916 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.425052 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.425534 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.425784 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.426035 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.426226 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.426558 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.426644 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.426967 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.427052 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.427330 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.427559 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.427668 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.428006 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.428090 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.428330 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.428502 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.428665 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.428959 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.429097 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.429278 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.429397 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.429619 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.429706 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.429936 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.430021 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.430263 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.430359 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.430597 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.430686 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.430906 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.430991 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.431215 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.431312 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.431529 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.431842 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.431935 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.432158 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.432244 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.432468 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.432605 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.432802 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.432897 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.433128 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.433262 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.433469 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.433579 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.433779 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.433867 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.434097 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.434193 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.434407 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.434494 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.434718 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.434804 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.435030 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.435127 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.435339 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.435425 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.435656 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.435743 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.435965 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.436060 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.436277 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.436363 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.436585 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.436670 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.436891 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.436977 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.437204 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.437291 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.437554 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.437651 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.437862 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.437963 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.438166 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.438251 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.438474 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.438562 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.438778 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.438865 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.439088 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.439188 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.439396 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.439506 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.439704 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.439791 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.440013 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.440101 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.440327 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.440422 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.440634 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.440726 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.441602 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.441704 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.442173 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.442402 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.442490 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.442741 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.442827 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.443067 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.443210 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.443408 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.443508 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.443715 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.443839 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.444028 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.444123 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.444339 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.444435 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.444647 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.444733 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.444956 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.445051 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.445273 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.445393 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.445613 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.445701 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.445927 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.446030 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.446239 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.446325 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.446552 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.446639 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.446866 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.446962 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.447176 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.447263 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.447487 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.447574 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.447799 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.447895 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.448109 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.448196 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.448418 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.448506 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.448729 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.448825 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.449039 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.449126 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.449369 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.449463 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.449690 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.449780 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.450003 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.450097 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.450319 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.450415 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.450641 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.450727 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.450962 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.451048 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.451280 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.451375 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.451588 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.451682 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.451897 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.451982 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.452209 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.452304 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.452521 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.452607 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.452838 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.452932 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.453153 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.453246 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.453497 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.453595 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.453803 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.453890 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.454121 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.454436 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.454531 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.454752 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.454837 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.455067 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.455168 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.455388 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.455483 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.455703 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.455790 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.456019 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.456108 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.456341 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.456511 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.457465 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.457571 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.457854 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.458009 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.458212 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.458353 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.458548 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.458676 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.458895 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.459012 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.459226 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.459346 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.459555 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.459700 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.459865 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.460019 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.460174 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.460372 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.460481 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.460714 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.460801 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.461035 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.461121 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.461377 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.461466 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.461691 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.461786 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.461938 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 04:26:51.462025 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.462319 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.462628 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.462933 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.463239 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.463549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.463858 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.464160 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.464465 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.464767 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.465070 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.465401 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.465710 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.466020 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.466324 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.466628 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.466933 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.467237 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.467539 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.467871 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.468206 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.468523 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.468846 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.469157 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.469515 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.469828 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.470150 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.470474 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.470789 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.471102 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.471436 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.471746 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.472091 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.472493 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.472813 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.473127 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.473531 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.473797 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.474124 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.474432 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.474758 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.475074 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.475393 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.475708 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.476018 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.476345 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.476656 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.476968 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.477282 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.477611 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.477924 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.478239 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.478549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.478861 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.479177 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.479493 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.479827 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.480158 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.480468 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.480803 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.481131 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.481503 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.481819 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.482163 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.482491 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.482804 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.483120 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.483428 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:26:51.483672 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 04:26:51.616926 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO dbcounter [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Registered counter for database nova_api Sep 06 04:26:51.635911 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO dbcounter [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] Registered counter for database nova_api Sep 06 04:26:51.639139 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_db.sqlalchemy.engines [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:26:51.646221 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writer thread running {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:26:51.657623 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG oslo_db.sqlalchemy.engines [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:26:51.664588 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writer thread running {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:26:51.705169 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.context [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b1fcff94-52a9-4308-8b15-a7ecd9f60a15(cell1) {{(pid=106153) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 04:26:51.709462 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:26:51.709947 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:26:51.711511 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:26:51.712242 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:26:51.712690 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:26:51.714684 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:26:51.716674 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO dbcounter [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Registered counter for database nova_cell0 Sep 06 04:26:51.720674 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO dbcounter [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Registered counter for database nova_cell1 Sep 06 04:26:51.720872 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.context [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b1fcff94-52a9-4308-8b15-a7ecd9f60a15(cell1) {{(pid=106154) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 04:26:51.725534 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:26:51.726017 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:26:51.727600 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:26:51.728323 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:26:51.728771 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:26:51.729355 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_db.sqlalchemy.engines [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:26:51.730805 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:26:51.731502 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_db.sqlalchemy.engines [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:26:51.732831 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO dbcounter [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] Registered counter for database nova_cell0 Sep 06 04:26:51.736841 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writer thread running {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:26:51.736951 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO dbcounter [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] Registered counter for database nova_cell1 Sep 06 04:26:51.740174 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writer thread running {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:26:51.744488 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG oslo_db.sqlalchemy.engines [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:26:51.746149 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG oslo_db.sqlalchemy.engines [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:26:51.751919 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writer thread running {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:26:51.754419 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writer thread running {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:26:51.887832 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO dbcounter [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Registered counter for database nova_cell0 Sep 06 04:26:51.897371 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_db.sqlalchemy.engines [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:26:51.898727 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO dbcounter [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] Registered counter for database nova_cell0 Sep 06 04:26:51.902169 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writer thread running {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:26:51.907568 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG oslo_db.sqlalchemy.engines [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:26:51.912644 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writer thread running {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:26:52.311221 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: WARNING keystonemiddleware.auth_token [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 04:26:52.319043 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: WARNING keystonemiddleware.auth_token [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 04:26:52.335234 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: WARNING keystonemiddleware.auth_token [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 04:26:52.342538 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: WARNING keystonemiddleware.auth_token [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 04:26:52.659555 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: WARNING keystonemiddleware.auth_token [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 04:26:52.666247 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: WARNING keystonemiddleware.auth_token [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 04:26:52.671555 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b34f7879c0 pid: 106153 (default app) Sep 06 04:26:52.673636 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:26:52.674807 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001750 Sep 06 04:26:52.675276 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Tue Sep 6 04:26:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:26:52.690603 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: WARNING keystonemiddleware.auth_token [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 04:26:52.696618 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: WARNING keystonemiddleware.auth_token [None req-5164c2ba-6e8d-417d-b10f-45985f88b611 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 04:26:52.701933 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b34f7879c0 pid: 106154 (default app) Sep 06 04:28:14.685364 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:28:14.686293 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 06 04:28:14.686688 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 931 bytes} [Tue Sep 6 04:28:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:28:14.705613 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_api:SELECT=3 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:14.707571 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_cell1:SELECT=3 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:14.708980 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_cell0:SELECT=3 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:14.710022 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:15.569201 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-8017ed5c-61fc-4a6b-847c-622eb300dae9 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:28:15.602104 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-8017ed5c-61fc-4a6b-847c-622eb300dae9 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.907783 Sep 06 04:28:15.602960 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Sep 6 04:28:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:28:18.002596 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:28:18.003668 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-05f6a7cb-d032-41b3-b9de-673dc170dd8c None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Sep 06 04:28:18.004273 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 931 bytes} [Tue Sep 6 04:28:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:28:18.488284 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-bebf381d-edec-409a-83c3-9179b9c889ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "id": "c1", "ram": 256}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:18.589341 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-bebf381d-edec-409a-83c3-9179b9c889ea admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.578896 Sep 06 04:28:18.590086 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Sep 6 04:28:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:28:18.603963 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_api:SELECT=3 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:18.604823 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_cell0:SELECT=3 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:18.607070 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_cell1:SELECT=3 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:18.608180 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:18.814243 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-723588c6-d814-4a33-9ee8-e69d02c12e0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:18.956076 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-723588c6-d814-4a33-9ee8-e69d02c12e0e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.357255 Sep 06 04:28:18.956664 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Sep 6 04:28:18 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:28:21.337899 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-bebf381d-edec-409a-83c3-9179b9c889ea admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:28:21.339150 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-bebf381d-edec-409a-83c3-9179b9c889ea admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001733 Sep 06 04:28:21.339657 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 931 bytes} [Tue Sep 6 04:28:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:28:22.025205 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-d034157c-d46d-40c8-b876-7d5a7f06648f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "id": "d1", "ram": 512, "disk": 5, "name": "ds512M"}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:22.190821 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-d034157c-d46d-40c8-b876-7d5a7f06648f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.844636 Sep 06 04:28:22.192308 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Sep 6 04:28:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:28:22.204123 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-c13570a9-d3c2-444c-9112-61657a309611 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:22.301853 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-c13570a9-d3c2-444c-9112-61657a309611 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100444 Sep 06 04:28:22.302483 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Sep 6 04:28:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:28:24.699109 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-d034157c-d46d-40c8-b876-7d5a7f06648f admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:28:24.700032 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-d034157c-d46d-40c8-b876-7d5a7f06648f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Sep 06 04:28:24.700449 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 931 bytes} [Tue Sep 6 04:28:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:28:25.107922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-71a2d1fe-2fd4-47d1-a95a-96a4d76c65e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "ram": 1024, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:25.191369 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-71a2d1fe-2fd4-47d1-a95a-96a4d76c65e6 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.484424 Sep 06 04:28:25.191935 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Sep 6 04:28:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:28:25.204109 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-48ebe60c-01f6-4839-adb9-4b8fe0b51461 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:25.267654 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-48ebe60c-01f6-4839-adb9-4b8fe0b51461 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066890 Sep 06 04:28:25.268162 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Sep 6 04:28:25 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:28:27.687339 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-71a2d1fe-2fd4-47d1-a95a-96a4d76c65e6 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:28:27.688529 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-71a2d1fe-2fd4-47d1-a95a-96a4d76c65e6 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Sep 06 04:28:27.689094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 931 bytes} [Tue Sep 6 04:28:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:28:28.145768 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-bc19e888-cf7f-48bd-8ec6-a9568b9ccd46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:28.225693 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-bc19e888-cf7f-48bd-8ec6-a9568b9ccd46 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529706 Sep 06 04:28:28.226590 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Sep 6 04:28:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:28:28.238678 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-152ed177-8eb1-437c-8e1d-b9cb6ef1556b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:28.318671 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-152ed177-8eb1-437c-8e1d-b9cb6ef1556b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083812 Sep 06 04:28:28.319615 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Sep 6 04:28:28 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:28:30.721724 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-bc19e888-cf7f-48bd-8ec6-a9568b9ccd46 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:28:30.723844 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-bc19e888-cf7f-48bd-8ec6-a9568b9ccd46 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002565 Sep 06 04:28:30.724512 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 931 bytes} [Tue Sep 6 04:28:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:28:31.153793 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-7199ec9d-ecb3-475d-81db-50f0dfeac2eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:31.245402 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-7199ec9d-ecb3-475d-81db-50f0dfeac2eb admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.514616 Sep 06 04:28:31.246209 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Sep 6 04:28:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:28:31.259591 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-5db7b9d0-dc3a-412b-bbda-c952ef29e01d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:31.336823 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-5db7b9d0-dc3a-412b-bbda-c952ef29e01d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081458 Sep 06 04:28:31.337818 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Sep 6 04:28:31 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:28:33.944383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-7199ec9d-ecb3-475d-81db-50f0dfeac2eb admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:28:33.946216 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-7199ec9d-ecb3-475d-81db-50f0dfeac2eb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001898 Sep 06 04:28:33.946769 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 931 bytes} [Tue Sep 6 04:28:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:28:34.380517 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-c2ead7f6-f9a7-4169-aa7d-02a316eb6ae7 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:28:34.405765 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-c2ead7f6-f9a7-4169-aa7d-02a316eb6ae7 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.452714 Sep 06 04:28:34.406310 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Sep 6 04:28:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:28:36.845014 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-7199ec9d-ecb3-475d-81db-50f0dfeac2eb admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:28:36.846116 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-7199ec9d-ecb3-475d-81db-50f0dfeac2eb admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Sep 06 04:28:36.846548 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 931 bytes} [Tue Sep 6 04:28:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:28:37.313478 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-43b30efa-80b4-4426-ab65-12d5537105b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "1", "rxtx_factor": 1.0, "disk": 1, "ram": 512}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:37.392065 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-43b30efa-80b4-4426-ab65-12d5537105b0 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.538311 Sep 06 04:28:37.393396 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Sep 6 04:28:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:28:37.407626 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-f7e5c79b-808b-4bb3-88ad-d88c0a631fce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:37.486225 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-f7e5c79b-808b-4bb3-88ad-d88c0a631fce admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083350 Sep 06 04:28:37.486949 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Sep 6 04:28:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:28:39.885504 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-43b30efa-80b4-4426-ab65-12d5537105b0 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:28:39.886527 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-43b30efa-80b4-4426-ab65-12d5537105b0 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001637 Sep 06 04:28:39.886930 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 931 bytes} [Tue Sep 6 04:28:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:28:40.277887 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-f9468702-9428-4bcc-9b22-e04c7d589b06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "ram": 2048, "id": "2", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:40.338872 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-f9468702-9428-4bcc-9b22-e04c7d589b06 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.445363 Sep 06 04:28:40.339699 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Sep 6 04:28:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:28:40.351990 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-6aa64057-d417-41f9-8a93-086f66d16fa8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:40.427141 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-6aa64057-d417-41f9-8a93-086f66d16fa8 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078857 Sep 06 04:28:40.427711 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Sep 6 04:28:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:28:42.808917 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-f9468702-9428-4bcc-9b22-e04c7d589b06 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:28:42.809980 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-f9468702-9428-4bcc-9b22-e04c7d589b06 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 06 04:28:42.810665 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 931 bytes} [Tue Sep 6 04:28:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:28:43.273044 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-92181877-0694-4ab2-917a-c24058610a85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:43.396905 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-92181877-0694-4ab2-917a-c24058610a85 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.576172 Sep 06 04:28:43.397696 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Sep 6 04:28:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:28:43.410165 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-134e6c7b-a745-423f-9ab3-49a57a86ddf1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:43.506287 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-134e6c7b-a745-423f-9ab3-49a57a86ddf1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099767 Sep 06 04:28:43.507314 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Sep 6 04:28:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:28:46.001771 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-92181877-0694-4ab2-917a-c24058610a85 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:28:46.006331 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-92181877-0694-4ab2-917a-c24058610a85 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.007045 Sep 06 04:28:46.006796 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 931 bytes} [Tue Sep 6 04:28:45 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:28:46.579369 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-dfc025bc-1cac-4253-988a-49aa382362d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:46.586178 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:46.681339 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-dfc025bc-1cac-4253-988a-49aa382362d7 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.667679 Sep 06 04:28:46.681815 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Sep 6 04:28:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:28:46.694645 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-977a5425-586c-4ed4-b3c0-c25dd85fc29e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:46.781591 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-977a5425-586c-4ed4-b3c0-c25dd85fc29e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090708 Sep 06 04:28:46.782758 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Sep 6 04:28:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:28:49.192808 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-dfc025bc-1cac-4253-988a-49aa382362d7 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:28:49.193834 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-dfc025bc-1cac-4253-988a-49aa382362d7 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 06 04:28:49.194225 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 931 bytes} [Tue Sep 6 04:28:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:28:49.694535 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-7f8fa4fd-064f-440d-93b0-1ce810eeaf80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "vcpus": 8, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "5"}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:49.704270 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:28:50.378519 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-7f8fa4fd-064f-440d-93b0-1ce810eeaf80 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 1.177766 Sep 06 04:28:50.383342 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Sep 6 04:28:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 04:28:50.399166 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-e41de8da-28fa-4787-88ee-1981cfd86553 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:28:50.530595 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-e41de8da-28fa-4787-88ee-1981cfd86553 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.138822 Sep 06 04:28:50.531209 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Sep 6 04:28:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:29:09.602207 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-7f8fa4fd-064f-440d-93b0-1ce810eeaf80 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:09.603222 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-7f8fa4fd-064f-440d-93b0-1ce810eeaf80 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 06 04:29:09.603623 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 931 bytes} [Tue Sep 6 04:29:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:29:09.996894 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-9058263c-3964-465c-afe6-e3610957ef6b admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:10.015096 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-9058263c-3964-465c-afe6-e3610957ef6b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405433 Sep 06 04:29:10.015621 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Sep 6 04:29:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:29:11.075559 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-7f8fa4fd-064f-440d-93b0-1ce810eeaf80 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:11.076585 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-7f8fa4fd-064f-440d-93b0-1ce810eeaf80 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 06 04:29:11.076974 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Sep 6 04:29:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:29:11.600347 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-ce135a01-f2c4-4b88-bc4f-4e7101fecd25 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:11.605883 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.wsgi [None req-ce135a01-f2c4-4b88-bc4f-4e7101fecd25 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-ce135a01-f2c4-4b88-bc4f-4e7101fecd25 admin admin] Request method failure captured: Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Accept: application/json Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Accept-Encoding: gzip, deflate Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Connection: keep-alive Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Content-Length: 0 Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Host: 10.222.0.30 Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Openstack-Api-Version: compute 2.92 Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Openstack-System-Scope: None Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: User-Agent: python-novaclient Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Auth-Token: gAAAAABjFsyWbxcFVHJ-hFQhgbKXkDmjhdMlpyuczNj8gBruw7OouOir5ALfgZi6mqE-jYK1cRWZ6cRShiuLuaFoUPJDwp7Kpy7ORji9G8I4uVaGC_btvEwnCz8pGuJaoTDcZIxGpmeonvgIVDGpoabu5P874nM2QLtMGdy6u2rhD5Ofn3TpRHg Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Domain-Id: None Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Domain-Name: None Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Identity-Status: Confirmed Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Is-Admin-Project: True Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Project-Domain-Id: default Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Project-Domain-Name: Default Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Project-Id: 8b3067b612904279b76189015d91b056 Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Project-Name: admin Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Role: member,admin,reader Sep 06 04:29:11.609084 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Roles: member,admin,reader Sep 06 04:29:11.610857 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8b3067b612904279b76189015d91b056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b3067b612904279b76189015d91b056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8b3067b612904279b76189015d91b056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b3067b612904279b76189015d91b056"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:29:11.610857 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Tenant: admin Sep 06 04:29:11.610857 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Tenant-Id: 8b3067b612904279b76189015d91b056 Sep 06 04:29:11.610857 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Tenant-Name: admin Sep 06 04:29:11.610857 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-User: admin Sep 06 04:29:11.610857 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-User-Domain-Id: default Sep 06 04:29:11.610857 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-User-Domain-Name: Default Sep 06 04:29:11.610857 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-User-Id: b7c5062264774b85bf945fb9ac7602db Sep 06 04:29:11.610857 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-User-Name: admin Sep 06 04:29:11.610857 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: method: > Sep 06 04:29:11.610857 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: exception: Flavor 42 could not be found. Sep 06 04:29:11.610857 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: action_args: {'id': '42'} Sep 06 04:29:11.610857 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:29:11.610857 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:29:11.612094 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Sep 06 04:29:11.613549 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-ce135a01-f2c4-4b88-bc4f-4e7101fecd25 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:29:11.614862 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-ce135a01-f2c4-4b88-bc4f-4e7101fecd25 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.397470 Sep 06 04:29:11.614862 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Sep 6 04:29:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:11.620291 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-59b9be79-9de8-462c-857b-060268a4c569 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:11.644488 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-59b9be79-9de8-462c-857b-060268a4c569 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027713 Sep 06 04:29:11.645052 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Sep 6 04:29:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:29:11.658666 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-ef2e85f9-0d50-4cbd-b4fe-c0d17e4fe59f admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:11.681568 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-ef2e85f9-0d50-4cbd-b4fe-c0d17e4fe59f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027067 Sep 06 04:29:11.682109 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Sep 6 04:29:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:29:11.691522 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-fd017083-21e5-493a-bf2e-460702b6a543 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:11.698046 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.wsgi [None req-fd017083-21e5-493a-bf2e-460702b6a543 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-fd017083-21e5-493a-bf2e-460702b6a543 admin admin] Request method failure captured: Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Accept: application/json Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Accept-Encoding: gzip, deflate Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Connection: keep-alive Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Content-Length: 0 Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Host: 10.222.0.30 Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Openstack-Api-Version: compute 2.92 Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Openstack-System-Scope: None Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: User-Agent: python-novaclient Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Auth-Token: gAAAAABjFsyWbxcFVHJ-hFQhgbKXkDmjhdMlpyuczNj8gBruw7OouOir5ALfgZi6mqE-jYK1cRWZ6cRShiuLuaFoUPJDwp7Kpy7ORji9G8I4uVaGC_btvEwnCz8pGuJaoTDcZIxGpmeonvgIVDGpoabu5P874nM2QLtMGdy6u2rhD5Ofn3TpRHg Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Domain-Id: None Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Domain-Name: None Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Identity-Status: Confirmed Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Is-Admin-Project: True Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Project-Domain-Id: default Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Project-Domain-Name: Default Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Project-Id: 8b3067b612904279b76189015d91b056 Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Project-Name: admin Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Role: member,admin,reader Sep 06 04:29:11.701235 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Roles: member,admin,reader Sep 06 04:29:11.702642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8b3067b612904279b76189015d91b056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b3067b612904279b76189015d91b056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8b3067b612904279b76189015d91b056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b3067b612904279b76189015d91b056"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:29:11.702642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Tenant: admin Sep 06 04:29:11.702642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Tenant-Id: 8b3067b612904279b76189015d91b056 Sep 06 04:29:11.702642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Tenant-Name: admin Sep 06 04:29:11.702642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-User: admin Sep 06 04:29:11.702642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-User-Domain-Id: default Sep 06 04:29:11.702642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-User-Domain-Name: Default Sep 06 04:29:11.702642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-User-Id: b7c5062264774b85bf945fb9ac7602db Sep 06 04:29:11.702642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-User-Name: admin Sep 06 04:29:11.702642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: method: > Sep 06 04:29:11.702642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: exception: Flavor 42 could not be found. Sep 06 04:29:11.702642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: action_args: {'id': '42'} Sep 06 04:29:11.702642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:29:11.702642 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:29:11.703515 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Sep 06 04:29:11.704797 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-fd017083-21e5-493a-bf2e-460702b6a543 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:29:11.706050 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-fd017083-21e5-493a-bf2e-460702b6a543 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014619 Sep 06 04:29:11.706050 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Sep 6 04:29:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:12.693705 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-ef2e85f9-0d50-4cbd-b4fe-c0d17e4fe59f admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:12.694745 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-ef2e85f9-0d50-4cbd-b4fe-c0d17e4fe59f admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002275 Sep 06 04:29:12.695157 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Sep 6 04:29:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:29:13.220391 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-61eee967-f26e-42c2-82ca-e00d5448450e admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:13.226541 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.wsgi [None req-61eee967-f26e-42c2-82ca-e00d5448450e admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-61eee967-f26e-42c2-82ca-e00d5448450e admin admin] Request method failure captured: Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Accept: application/json Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Accept-Encoding: gzip, deflate Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Connection: keep-alive Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Content-Length: 0 Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Host: 10.222.0.30 Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Openstack-Api-Version: compute 2.92 Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Openstack-System-Scope: None Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: User-Agent: python-novaclient Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Auth-Token: gAAAAABjFsyYQReB08KjQf2m2JUv7btSCq99hsxPLXQkYqBAoEncZ70OIncuox-eShC9XEah_nJRcnLlDx4jElUYcUz2TSkK6YKsK5EZ1_6rsZFEhR3JfDsuCPVrNktT3e6KgMvRMIfHvxAM_uOyHjPHFft1eeOXGJV6c5RBuSyuEXZniJaRoz0 Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Domain-Id: None Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Domain-Name: None Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Identity-Status: Confirmed Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Is-Admin-Project: True Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Project-Domain-Id: default Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Project-Domain-Name: Default Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Project-Id: 8b3067b612904279b76189015d91b056 Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Project-Name: admin Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Role: member,admin,reader Sep 06 04:29:13.228078 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Roles: member,admin,reader Sep 06 04:29:13.229620 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8b3067b612904279b76189015d91b056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b3067b612904279b76189015d91b056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8b3067b612904279b76189015d91b056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b3067b612904279b76189015d91b056"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:29:13.229620 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Tenant: admin Sep 06 04:29:13.229620 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Tenant-Id: 8b3067b612904279b76189015d91b056 Sep 06 04:29:13.229620 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Tenant-Name: admin Sep 06 04:29:13.229620 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-User: admin Sep 06 04:29:13.229620 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-User-Domain-Id: default Sep 06 04:29:13.229620 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-User-Domain-Name: Default Sep 06 04:29:13.229620 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-User-Id: b7c5062264774b85bf945fb9ac7602db Sep 06 04:29:13.229620 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-User-Name: admin Sep 06 04:29:13.229620 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: method: > Sep 06 04:29:13.229620 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: exception: Flavor 84 could not be found. Sep 06 04:29:13.229620 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: action_args: {'id': '84'} Sep 06 04:29:13.229620 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:29:13.229620 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:29:13.230593 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Sep 06 04:29:13.231862 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-61eee967-f26e-42c2-82ca-e00d5448450e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:29:13.233081 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-61eee967-f26e-42c2-82ca-e00d5448450e admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.393610 Sep 06 04:29:13.233081 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Sep 6 04:29:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:13.239737 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-6363644d-11e3-4d85-81b7-b63337d48004 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:13.254426 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-6363644d-11e3-4d85-81b7-b63337d48004 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018824 Sep 06 04:29:13.254955 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Sep 6 04:29:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:29:13.264267 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-df68a890-a0b4-444d-ad67-4cdee93f4c54 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:13.279532 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-df68a890-a0b4-444d-ad67-4cdee93f4c54 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018802 Sep 06 04:29:13.280045 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Sep 6 04:29:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:29:13.289644 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-93107796-e83c-43ac-8436-e88a4bf6291d admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:13.294884 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.wsgi [None req-93107796-e83c-43ac-8436-e88a4bf6291d admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-93107796-e83c-43ac-8436-e88a4bf6291d admin admin] Request method failure captured: Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Accept: application/json Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Accept-Encoding: gzip, deflate Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Connection: keep-alive Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Content-Length: 0 Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Host: 10.222.0.30 Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Openstack-Api-Version: compute 2.92 Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Openstack-System-Scope: None Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: User-Agent: python-novaclient Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Auth-Token: gAAAAABjFsyYQReB08KjQf2m2JUv7btSCq99hsxPLXQkYqBAoEncZ70OIncuox-eShC9XEah_nJRcnLlDx4jElUYcUz2TSkK6YKsK5EZ1_6rsZFEhR3JfDsuCPVrNktT3e6KgMvRMIfHvxAM_uOyHjPHFft1eeOXGJV6c5RBuSyuEXZniJaRoz0 Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Domain-Id: None Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Domain-Name: None Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Identity-Status: Confirmed Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Is-Admin-Project: True Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Project-Domain-Id: default Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Project-Domain-Name: Default Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Project-Id: 8b3067b612904279b76189015d91b056 Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Project-Name: admin Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Role: member,admin,reader Sep 06 04:29:13.296381 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Roles: member,admin,reader Sep 06 04:29:13.297905 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8b3067b612904279b76189015d91b056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b3067b612904279b76189015d91b056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8b3067b612904279b76189015d91b056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b3067b612904279b76189015d91b056"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:29:13.297905 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Tenant: admin Sep 06 04:29:13.297905 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Tenant-Id: 8b3067b612904279b76189015d91b056 Sep 06 04:29:13.297905 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Tenant-Name: admin Sep 06 04:29:13.297905 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-User: admin Sep 06 04:29:13.297905 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-User-Domain-Id: default Sep 06 04:29:13.297905 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-User-Domain-Name: Default Sep 06 04:29:13.297905 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-User-Id: b7c5062264774b85bf945fb9ac7602db Sep 06 04:29:13.297905 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-User-Name: admin Sep 06 04:29:13.297905 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: method: > Sep 06 04:29:13.297905 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: exception: Flavor 84 could not be found. Sep 06 04:29:13.297905 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: action_args: {'id': '84'} Sep 06 04:29:13.297905 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:29:13.297905 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:29:13.298922 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Sep 06 04:29:13.300355 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-93107796-e83c-43ac-8436-e88a4bf6291d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:29:13.303051 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-93107796-e83c-43ac-8436-e88a4bf6291d admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012273 Sep 06 04:29:13.303051 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Sep 6 04:29:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:14.284060 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-df68a890-a0b4-444d-ad67-4cdee93f4c54 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:14.285061 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-df68a890-a0b4-444d-ad67-4cdee93f4c54 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Sep 06 04:29:14.285496 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Sep 6 04:29:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:29:14.811634 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-fb2e1082-05fe-4bac-9c51-f7061b91fa76 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:14.817416 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.wsgi [None req-fb2e1082-05fe-4bac-9c51-f7061b91fa76 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-fb2e1082-05fe-4bac-9c51-f7061b91fa76 admin admin] Request method failure captured: Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Accept: application/json Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Accept-Encoding: gzip, deflate Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Connection: keep-alive Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Content-Length: 0 Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Host: 10.222.0.30 Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Openstack-Api-Version: compute 2.92 Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Openstack-System-Scope: None Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: User-Agent: python-novaclient Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Auth-Token: gAAAAABjFsya3K03zIWWzRV9JyjW4ds67Wd2EVNqzeYok7ZF7_Ox-kKmXYXHgBn_bGyaRkAsOTWx8ZKTQ2jWADw7Hb3C2MYXJ9kc2wUQIikBi1_KL6TRxFz0KgdDn3hlxnNtOOfe-kNPMFKFs7Cnb1C3cw2azTkk8GNx7AJfkIXnj1PKQ7h9JIM Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Domain-Id: None Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Domain-Name: None Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Identity-Status: Confirmed Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Is-Admin-Project: True Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Project-Domain-Id: default Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Project-Domain-Name: Default Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Project-Id: 8b3067b612904279b76189015d91b056 Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Project-Name: admin Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Role: member,admin,reader Sep 06 04:29:14.818907 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Roles: member,admin,reader Sep 06 04:29:14.820383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8b3067b612904279b76189015d91b056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b3067b612904279b76189015d91b056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8b3067b612904279b76189015d91b056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b3067b612904279b76189015d91b056"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:29:14.820383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Tenant: admin Sep 06 04:29:14.820383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Tenant-Id: 8b3067b612904279b76189015d91b056 Sep 06 04:29:14.820383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-Tenant-Name: admin Sep 06 04:29:14.820383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-User: admin Sep 06 04:29:14.820383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-User-Domain-Id: default Sep 06 04:29:14.820383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-User-Domain-Name: Default Sep 06 04:29:14.820383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-User-Id: b7c5062264774b85bf945fb9ac7602db Sep 06 04:29:14.820383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: X-User-Name: admin Sep 06 04:29:14.820383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: method: > Sep 06 04:29:14.820383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: exception: Flavor 451 could not be found. Sep 06 04:29:14.820383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: action_args: {'id': '451'} Sep 06 04:29:14.820383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:29:14.820383 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:29:14.821230 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Sep 06 04:29:14.822622 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-fb2e1082-05fe-4bac-9c51-f7061b91fa76 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:29:14.823873 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-fb2e1082-05fe-4bac-9c51-f7061b91fa76 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394433 Sep 06 04:29:14.823873 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Sep 6 04:29:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 06 04:29:14.829972 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-4a355fc7-3488-40a1-85be-b593389d4c60 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:14.845104 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-4a355fc7-3488-40a1-85be-b593389d4c60 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018644 Sep 06 04:29:14.848879 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Sep 6 04:29:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:29:14.855853 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-8bed60a6-493b-4868-afc1-08e6fbebb28b admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:14.871267 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-8bed60a6-493b-4868-afc1-08e6fbebb28b admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019138 Sep 06 04:29:14.871794 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Sep 6 04:29:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:29:14.881386 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-bb74d488-d2b7-415b-a820-e6e7b41269a4 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:14.886781 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.wsgi [None req-bb74d488-d2b7-415b-a820-e6e7b41269a4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-bb74d488-d2b7-415b-a820-e6e7b41269a4 admin admin] Request method failure captured: Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Accept: application/json Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Accept-Encoding: gzip, deflate Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Connection: keep-alive Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Content-Length: 0 Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Host: 10.222.0.30 Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Openstack-Api-Version: compute 2.92 Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Openstack-System-Scope: None Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: User-Agent: python-novaclient Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Auth-Token: gAAAAABjFsya3K03zIWWzRV9JyjW4ds67Wd2EVNqzeYok7ZF7_Ox-kKmXYXHgBn_bGyaRkAsOTWx8ZKTQ2jWADw7Hb3C2MYXJ9kc2wUQIikBi1_KL6TRxFz0KgdDn3hlxnNtOOfe-kNPMFKFs7Cnb1C3cw2azTkk8GNx7AJfkIXnj1PKQ7h9JIM Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Domain-Id: None Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Domain-Name: None Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Identity-Status: Confirmed Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Is-Admin-Project: True Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Openstack-Nova-Api-Version: 2.92 Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Project-Domain-Id: default Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Project-Domain-Name: Default Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Project-Id: 8b3067b612904279b76189015d91b056 Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Project-Name: admin Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Role: member,admin,reader Sep 06 04:29:14.888290 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Roles: member,admin,reader Sep 06 04:29:14.889812 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8b3067b612904279b76189015d91b056"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b3067b612904279b76189015d91b056"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8b3067b612904279b76189015d91b056"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8b3067b612904279b76189015d91b056"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:29:14.889812 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Tenant: admin Sep 06 04:29:14.889812 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Tenant-Id: 8b3067b612904279b76189015d91b056 Sep 06 04:29:14.889812 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-Tenant-Name: admin Sep 06 04:29:14.889812 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-User: admin Sep 06 04:29:14.889812 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-User-Domain-Id: default Sep 06 04:29:14.889812 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-User-Domain-Name: Default Sep 06 04:29:14.889812 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-User-Id: b7c5062264774b85bf945fb9ac7602db Sep 06 04:29:14.889812 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: X-User-Name: admin Sep 06 04:29:14.889812 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: method: > Sep 06 04:29:14.889812 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: exception: Flavor 451 could not be found. Sep 06 04:29:14.889812 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: action_args: {'id': '451'} Sep 06 04:29:14.889812 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:29:14.889812 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:29:14.890986 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Sep 06 04:29:14.892255 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-bb74d488-d2b7-415b-a820-e6e7b41269a4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:29:14.893794 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-bb74d488-d2b7-415b-a820-e6e7b41269a4 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012127 Sep 06 04:29:14.893794 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Sep 6 04:29:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 06 04:29:15.860658 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-8bed60a6-493b-4868-afc1-08e6fbebb28b admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:15.861683 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-8bed60a6-493b-4868-afc1-08e6fbebb28b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 06 04:29:15.862078 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Sep 6 04:29:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:29:16.387764 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-613b7a72-74e5-49fe-96d5-4500f1bb4385 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:29:16.457037 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-613b7a72-74e5-49fe-96d5-4500f1bb4385 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.458336 Sep 06 04:29:16.457624 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Sep 6 04:29:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:29:17.428653 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-8bed60a6-493b-4868-afc1-08e6fbebb28b admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:17.429681 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-8bed60a6-493b-4868-afc1-08e6fbebb28b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Sep 06 04:29:17.430074 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Sep 6 04:29:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:29:17.944198 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-2038989f-d7ec-40f6-b88c-2f9a48050110 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:29:18.028182 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-2038989f-d7ec-40f6-b88c-2f9a48050110 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.462700 Sep 06 04:29:18.028665 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Sep 6 04:29:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:29:18.997604 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-8bed60a6-493b-4868-afc1-08e6fbebb28b admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:18.998598 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-8bed60a6-493b-4868-afc1-08e6fbebb28b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 06 04:29:18.998989 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Sep 6 04:29:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:29:19.522395 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-f3fce3ac-1470-4d42-9c42-d2c3e700662d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:29:19.611514 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-f3fce3ac-1470-4d42-9c42-d2c3e700662d admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.476820 Sep 06 04:29:19.612053 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Sep 6 04:29:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 04:29:20.591400 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-8bed60a6-493b-4868-afc1-08e6fbebb28b admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:20.592503 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-8bed60a6-493b-4868-afc1-08e6fbebb28b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Sep 06 04:29:20.592974 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Sep 6 04:29:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:29:21.115782 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-23b85603-1f2a-4d54-b654-76c58bd9da88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:29:21.177438 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-23b85603-1f2a-4d54-b654-76c58bd9da88 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.443960 Sep 06 04:29:21.177925 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Sep 6 04:29:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:29:22.153778 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-8bed60a6-493b-4868-afc1-08e6fbebb28b admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:22.154817 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-8bed60a6-493b-4868-afc1-08e6fbebb28b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 06 04:29:22.155238 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Sep 6 04:29:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:29:22.675656 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-3ddb81a9-9504-4308-a77e-ac1faac4d651 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:29:22.696591 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-3ddb81a9-9504-4308-a77e-ac1faac4d651 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.403805 Sep 06 04:29:22.697123 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Tue Sep 6 04:29:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:30:16.929258 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-8bed60a6-493b-4868-afc1-08e6fbebb28b admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:30:16.930309 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-8bed60a6-493b-4868-afc1-08e6fbebb28b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 06 04:30:16.930713 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 931 bytes} [Tue Sep 6 04:30:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:30:16.941725 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:30:17.427446 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-6eae3cf4-74a4-4f6d-9c74-dba367496501 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:30:17.448530 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-6eae3cf4-74a4-4f6d-9c74-dba367496501 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.511698 Sep 06 04:30:17.449075 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Sep 6 04:30:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:30:17.469674 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:30:17.473545 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-b3bd788b-5081-4262-962e-08cbab20bb35 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:30:17.481075 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-b3bd788b-5081-4262-962e-08cbab20bb35 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012812 Sep 06 04:30:17.481689 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1283 bytes} [Tue Sep 6 04:30:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:30:17.493886 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-a53f3cbd-9e5a-44b1-91ef-ee0d16ecf4dd admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:30:17.501618 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-a53f3cbd-9e5a-44b1-91ef-ee0d16ecf4dd admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011265 Sep 06 04:30:17.502134 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1286 bytes} [Tue Sep 6 04:30:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:30:17.515315 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-f184325e-f21b-44da-bdc5-0740a91e0c97 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:30:17.523761 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-f184325e-f21b-44da-bdc5-0740a91e0c97 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012660 Sep 06 04:30:17.524369 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1286 bytes} [Tue Sep 6 04:30:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:30:17.536016 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-26819ab0-5954-498c-8827-3deb14e0ea5a admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:30:17.543739 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-26819ab0-5954-498c-8827-3deb14e0ea5a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011605 Sep 06 04:30:17.544265 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1283 bytes} [Tue Sep 6 04:30:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:33:21.075632 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-f184325e-f21b-44da-bdc5-0740a91e0c97 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:33:21.076650 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-f184325e-f21b-44da-bdc5-0740a91e0c97 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 06 04:33:21.077048 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Sep 6 04:33:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:33:21.218616 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_api:SELECT=6 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:33:21.383397 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-b7396807-078b-4794-8aac-935346f198cf admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:33:21.387594 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-b7396807-078b-4794-8aac-935346f198cf admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:33:21.388071 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-b7396807-078b-4794-8aac-935346f198cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:33:21.388498 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-b7396807-078b-4794-8aac-935346f198cf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:33:21.389209 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-b7396807-078b-4794-8aac-935346f198cf admin admin] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:33:21.389706 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-b7396807-078b-4794-8aac-935346f198cf admin admin] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:33:21.390124 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-b7396807-078b-4794-8aac-935346f198cf admin admin] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:33:21.424456 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-b7396807-078b-4794-8aac-935346f198cf admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.207427 Sep 06 04:33:21.425015 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Sep 6 04:33:21 2022] GET /compute/v2.1/os-services => generated 791 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:33:22.262108 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-f184325e-f21b-44da-bdc5-0740a91e0c97 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:33:22.263118 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-f184325e-f21b-44da-bdc5-0740a91e0c97 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 06 04:33:22.263516 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Sep 6 04:33:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:33:22.457897 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-c2e5b633-c6cf-42a7-94ae-6012bd7831c8 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:33:22.461424 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-c2e5b633-c6cf-42a7-94ae-6012bd7831c8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:33:22.462018 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-c2e5b633-c6cf-42a7-94ae-6012bd7831c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:33:22.462713 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-c2e5b633-c6cf-42a7-94ae-6012bd7831c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:33:22.463457 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-c2e5b633-c6cf-42a7-94ae-6012bd7831c8 admin admin] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:33:22.463908 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-c2e5b633-c6cf-42a7-94ae-6012bd7831c8 admin admin] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:33:22.464359 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-c2e5b633-c6cf-42a7-94ae-6012bd7831c8 admin admin] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:33:22.484083 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-c2e5b633-c6cf-42a7-94ae-6012bd7831c8 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.079716 Sep 06 04:33:22.484575 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Sep 6 04:33:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:33:33.773451 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-f184325e-f21b-44da-bdc5-0740a91e0c97 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:33:33.774462 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-f184325e-f21b-44da-bdc5-0740a91e0c97 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 06 04:33:33.774859 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Sep 6 04:33:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:33:33.918846 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_cell0:SELECT=4 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:33:33.919560 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_cell1:SELECT=4 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:33:33.920167 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_api:SELECT=8 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:33:33.968473 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-3cf19b36-fd02-488c-8f0f-0641c13b866c admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:33:33.971873 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-3cf19b36-fd02-488c-8f0f-0641c13b866c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:33:33.974294 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-3cf19b36-fd02-488c-8f0f-0641c13b866c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:33:33.974294 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-3cf19b36-fd02-488c-8f0f-0641c13b866c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:33:33.974294 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-3cf19b36-fd02-488c-8f0f-0641c13b866c admin admin] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:33:33.974294 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-3cf19b36-fd02-488c-8f0f-0641c13b866c admin admin] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:33:33.974703 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-3cf19b36-fd02-488c-8f0f-0641c13b866c admin admin] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:33:34.002999 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-3cf19b36-fd02-488c-8f0f-0641c13b866c admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086356 Sep 06 04:33:34.002999 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Sep 6 04:33:33 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:33:34.843300 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-f184325e-f21b-44da-bdc5-0740a91e0c97 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:33:34.844293 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-f184325e-f21b-44da-bdc5-0740a91e0c97 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Sep 06 04:33:34.844688 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 37/75] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Sep 6 04:33:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:33:35.034712 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-2a5e1cc3-c642-4c05-8709-e7899b4cf787 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:33:35.038071 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-2a5e1cc3-c642-4c05-8709-e7899b4cf787 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:33:35.038540 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-2a5e1cc3-c642-4c05-8709-e7899b4cf787 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:33:35.038959 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-2a5e1cc3-c642-4c05-8709-e7899b4cf787 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:33:35.039684 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-2a5e1cc3-c642-4c05-8709-e7899b4cf787 admin admin] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:33:35.040812 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-2a5e1cc3-c642-4c05-8709-e7899b4cf787 admin admin] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:33:35.041220 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-2a5e1cc3-c642-4c05-8709-e7899b4cf787 admin admin] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:33:35.062574 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-2a5e1cc3-c642-4c05-8709-e7899b4cf787 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.080065 Sep 06 04:33:35.063052 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 39/76] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Sep 6 04:33:34 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:34:31.951709 dv-cinder-856002-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 06 04:34:31.952265 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: Tue Sep 6 04:34:31 2022 - graceful shutdown triggered... Sep 06 04:34:31.952737 dv-cinder-856002-1-iscsi devstack@n-api.service[106153]: Gracefully killing worker 1 (pid: 106153)... Sep 06 04:34:31.953703 dv-cinder-856002-1-iscsi devstack@n-api.service[106154]: Gracefully killing worker 2 (pid: 106154)... Sep 06 04:34:32.953420 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: worker 1 buried after 1 seconds Sep 06 04:34:32.953961 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: worker 2 buried after 1 seconds Sep 06 04:34:32.953961 dv-cinder-856002-1-iscsi devstack@n-api.service[106152]: goodbye to uWSGI. Sep 06 04:34:32.955012 dv-cinder-856002-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 06 04:34:32.955569 dv-cinder-856002-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 06 04:34:32.958417 dv-cinder-856002-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 06 04:34:32.967616 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 06 04:34:32.970636 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 04:34:32 2022] *** Sep 06 04:34:32.970636 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 04:34:32.970636 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 04:34:32.970636 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: nodename: dv-cinder-856002-1-iscsi Sep 06 04:34:32.970636 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: machine: x86_64 Sep 06 04:34:32.970636 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: clock source: unix Sep 06 04:34:32.970636 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: pcre jit disabled Sep 06 04:34:32.970636 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: detected number of CPU cores: 4 Sep 06 04:34:32.970636 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: current working directory: / Sep 06 04:34:32.970636 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: detected binary path: /usr/bin/uwsgi-core Sep 06 04:34:32.970636 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: your processes number limit is 47680 Sep 06 04:34:32.971411 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: your memory page size is 4096 bytes Sep 06 04:34:32.971411 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: detected max file descriptor number: 2048 Sep 06 04:34:32.971411 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: lock engine: pthread robust mutexes Sep 06 04:34:32.971411 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: thunder lock: enabled Sep 06 04:34:32.971411 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 06 04:34:32.971411 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 04:34:33.011983 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: Python main interpreter initialized at 0x557418afd9c0 Sep 06 04:34:33.011983 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: python threads support enabled Sep 06 04:34:33.011983 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: your server socket listen backlog is limited to 100 connections Sep 06 04:34:33.011983 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: your mercy for graceful operations on workers is 90 seconds Sep 06 04:34:33.012429 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 04:34:33.012429 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: *** Operational MODE: preforking *** Sep 06 04:34:33.012709 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: *** uWSGI is running in multiple interpreter mode *** Sep 06 04:34:33.012709 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: spawned uWSGI master process (pid: 127596) Sep 06 04:34:33.012915 dv-cinder-856002-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 06 04:34:33.015971 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: spawned uWSGI worker 1 (pid: 127617, cores: 1) Sep 06 04:34:33.015971 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: spawned uWSGI worker 2 (pid: 127618, cores: 1) Sep 06 04:34:33.015971 dv-cinder-856002-1-iscsi devstack@n-api.service[127596]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 04:34:33.695562 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 04:34:33.703843 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 06 04:34:34.881075 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 04:34:34.881075 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: from cryptography.utils import int_from_bytes Sep 06 04:34:34.881763 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 04:34:34.881763 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: from cryptography.utils import int_from_bytes Sep 06 04:34:34.921368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 04:34:34.921368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: from cryptography.utils import int_from_bytes Sep 06 04:34:34.921368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 04:34:34.921368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: from cryptography.utils import int_from_bytes Sep 06 04:34:37.313990 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 04:34:37.314554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 04:34:37.314806 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 04:34:37.315169 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 04:34:37.315424 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 04:34:37.315812 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.316144 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.316468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.316787 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.317123 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.317582 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.317943 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.318268 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.318599 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.318862 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.319178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.319676 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856002-1-iscsi {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.320007 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.320317 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.320632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.320953 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.321260 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.321612 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.321930 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.322553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.324605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.324955 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.325273 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.325646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.325973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.326293 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.326623 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.326932 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.327270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.327594 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.327998 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856002-1-iscsi {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.328323 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.328640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.328955 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.329411 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.329727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.330041 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.330375 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.330687 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.330999 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.331326 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.331645 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.331990 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.332291 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.332594 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.332905 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.333216 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.333559 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.333867 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.334171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.334420 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.334725 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.335046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.335365 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.335686 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.335936 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.336191 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.336510 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.336830 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.337141 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.337477 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.337785 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.338090 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.338400 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.338711 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.339015 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.339389 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.339717 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.340038 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.340357 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.340676 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.340988 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.341428 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.341683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.341993 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.342339 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.342656 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.342962 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.343278 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.343594 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.343900 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.344205 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.344510 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.344827 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.345162 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.345490 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.345741 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.346042 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.346350 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.346667 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.346973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.347279 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.347585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.347882 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.348185 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.348492 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.348799 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.349106 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.349433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.349737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.350039 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.350346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.350652 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.350955 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.351280 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.351594 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.351901 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.352204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.352513 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.352819 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.353138 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.353466 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.353776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.354096 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.354399 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.354701 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.355554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.355862 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.356169 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.356584 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.356889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.357198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.357537 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.357848 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.358152 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.358453 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.358770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.359057 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.359358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.359658 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.359959 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.360257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.360576 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.360899 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.361208 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.361537 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.365172 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.366092 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 04:34:37.366846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.367040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 04:34:37.367236 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.367236 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.367551 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 04:34:37.367718 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.367892 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 04:34:37.368051 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.368210 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 04:34:37.368367 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.368521 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.368676 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.368827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.368991 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.369166 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.369360 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.369527 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.369706 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.369865 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.370024 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.370169 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.370320 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.370532 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.370703 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.370861 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.371029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.371187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.371340 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.371492 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.371638 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.373432 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.373621 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.373783 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856002-1-iscsi {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.373942 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.373942 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.374231 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.374397 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.374551 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.374695 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.374839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.374990 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.375135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.375287 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.375449 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.375604 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.375748 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.375891 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.376040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.376520 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.376691 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.376857 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.377601 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.377601 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.377798 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.377876 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.377964 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.378038 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.378115 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.378185 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.378267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.378339 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.378415 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.378486 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.378562 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.378633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.378715 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.378795 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.378865 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.378934 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.379018 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.379018 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.379165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856002-1-iscsi {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.379244 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.379315 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.379392 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.379479 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.379556 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.379627 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.379697 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.379776 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.379867 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.379965 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.380054 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.380134 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.380205 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.380275 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.380353 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.380434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.380517 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.380590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.380669 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.380740 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.380818 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.380897 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.380975 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.380975 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.381120 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.381199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.381278 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.381399 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.381483 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.381554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.381693 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.381808 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.381930 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.382049 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.382174 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.382287 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.382403 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.382522 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.382646 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.382757 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.382874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.382984 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.383101 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.383219 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.383343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.383463 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.383580 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.383580 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.383580 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.383894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.384023 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.384139 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.384281 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.384415 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.384553 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.384695 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.384826 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.384962 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.385100 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.385241 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.385412 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.385559 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.385694 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.385825 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.385954 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.386619 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.386761 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.386892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.387030 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.387168 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.387298 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.387437 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.387583 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.387583 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.387829 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.387967 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.388106 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.388106 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.388365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.388497 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.388628 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.388764 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.388895 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.389034 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.389171 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.389340 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.389473 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.389603 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.389733 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.389881 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.390014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.390143 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.390279 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.390418 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.390555 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.390697 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.390837 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.390968 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.391657 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.391751 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.391845 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.391943 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.392037 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.392037 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.392207 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.392207 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.392379 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.392379 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.392549 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.392641 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.392726 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.392809 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.392899 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.392992 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.393148 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.393244 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.393479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.393577 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.393791 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.393897 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.394093 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.394193 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.394395 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.394493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.394697 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.394796 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.395006 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.395108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.395310 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.395409 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.395618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.395718 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.395927 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.396027 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.396231 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.396330 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.396538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.396642 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.396926 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.397030 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.397150 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.397257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.397484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.397577 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.397806 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.397902 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.398381 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.398499 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.398693 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.398794 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.399000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.399102 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.399311 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.399405 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.399621 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.399721 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.399932 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.400031 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.400242 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.400333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.400554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.400652 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.400866 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.400966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.401172 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.401270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.401506 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.401612 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.401968 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.402062 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.402315 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.402429 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.402668 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.402806 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.402998 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.403188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.403319 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.403641 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.403926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.404266 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.404441 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.404597 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.404743 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.404887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.405051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.405205 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.405385 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.405537 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.405698 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.405850 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.405993 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.406146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.406289 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.406441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.406592 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.406743 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.406900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.407159 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.407309 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.407474 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.407780 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.408104 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.408431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.409384 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.409493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.409573 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.409662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.409745 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.409829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.409911 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.409983 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 04:34:37.410054 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.410125 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.410195 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.410621 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.410750 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.410845 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.410931 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.411113 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.411215 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.411446 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.411597 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.411782 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.411939 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.412097 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.412263 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.412413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.412581 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.412746 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.412902 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.413059 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.413232 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.413395 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.413576 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.413711 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.413894 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.414020 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.414208 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.414325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.414529 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.414621 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.414856 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.414962 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.415189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.415283 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.415509 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.415602 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.415830 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.415936 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.416145 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.416236 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.416455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.416555 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.416762 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.416864 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.417069 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.417832 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.417982 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.418194 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.418307 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.418404 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.418526 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.418694 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.418850 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.419044 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.419173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.419366 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.419466 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.419699 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.419799 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.420030 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.420186 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.420347 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.420450 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.420666 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.420766 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.420968 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.421068 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.421275 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.421451 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.421647 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.421739 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.421963 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.422062 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.422271 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.422363 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.422588 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.422687 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.422909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.423010 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.423224 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.423318 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.423537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.423628 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.423846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.423938 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.424156 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.424256 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.424468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.424566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.424780 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.424879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.425091 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.425184 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.425426 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.425582 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.425740 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.425869 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.426052 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.426171 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.426363 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.426459 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.426677 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.426776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.426986 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.427084 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.427302 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.427444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.427606 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.427731 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.427928 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.428044 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.428214 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.428358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.428533 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.428827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.429117 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.429224 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.429477 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.429592 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.429794 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.429896 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.430112 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.430214 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.430450 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.430558 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.430766 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.430877 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.431087 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.431181 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.431404 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.431507 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.433327 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.433479 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.433591 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.433694 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.433784 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.433876 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.433962 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.434053 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.434151 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.434235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.434318 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.434409 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.434409 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.434409 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.434409 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.434716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.434826 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.435113 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.435232 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.435441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.435566 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.436287 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.436405 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.436513 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.436587 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.436669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.436744 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.436822 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.436895 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.436965 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.437034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.437796 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.437894 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.437993 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.438088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.438183 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.438302 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.438710 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.438827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.438923 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.439017 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.439104 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.439219 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.439307 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.439399 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.439485 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.439575 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.439703 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.439893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.440046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.440205 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.440350 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.440502 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.440659 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.440803 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.440951 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.441092 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.441253 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.441424 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.441583 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.441725 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.441866 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.442018 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.442167 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.442272 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.442449 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.442553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.442777 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.442870 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.443093 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.443201 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.443405 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.443736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.443736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.444023 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.444175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.444327 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.444474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.444626 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.444773 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.444924 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.445071 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.445237 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.445400 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.445549 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.445692 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.445840 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.445988 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.446138 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.446287 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.446390 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.446485 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.446577 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.446676 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.446839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.446967 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.447157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.447273 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.447469 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.447584 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.447784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.447888 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.448108 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.448207 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.448424 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.449507 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.449507 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.449696 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.449790 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.449883 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.449978 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.450072 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.450159 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.450252 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.450469 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.450564 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.450774 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.450877 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.451083 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.451185 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.451391 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.451487 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.451695 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.451789 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.452013 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.452116 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.452324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.452418 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.452656 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.452807 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.452928 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.453023 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.453235 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.453374 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.453586 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.453756 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.453908 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.454063 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.454213 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.454371 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.454540 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.454699 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.454840 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.454992 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.455134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.455288 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.455436 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.455593 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.455746 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.455887 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.456029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.456178 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.456319 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.456478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.456627 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.456775 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.456930 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.457071 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.457220 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.457411 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.457561 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.457732 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.457887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.457985 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.458079 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.458307 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.458410 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.458632 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.458739 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.458945 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.459045 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.459290 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.459437 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.459552 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.459673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.459866 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.459963 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.460174 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.460277 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.460487 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.460582 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.460805 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.460907 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.461118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.461211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.461458 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.461572 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.461767 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.461859 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.462077 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.462169 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.462388 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.462488 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.462691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.462790 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.462999 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.463293 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.463399 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.463615 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.463748 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.463929 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.464030 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.464326 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.464454 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.464669 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.464898 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.465022 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.465111 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.465289 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.465413 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.465626 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.465719 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.465941 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.466049 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.466252 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.466347 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.466562 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.466666 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.466863 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.466966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.467172 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.467276 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.467481 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.467628 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.467789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.467879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.468098 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.468192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.468406 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.468500 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.468716 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.468817 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.469025 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.469130 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.469411 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.469555 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.469688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.469791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.469963 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.470062 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.470270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.470371 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.470581 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.470687 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.470890 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.470990 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.471194 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.471294 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.471506 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.471607 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.471814 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.471942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.472119 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.472220 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.472428 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.472523 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.472733 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.472826 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.473044 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.473135 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.473368 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.473480 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.473686 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.473782 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.474006 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.474146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.474399 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.474590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.474691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.474934 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.475026 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.475257 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.475364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.475584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.475678 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.475895 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.475993 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.476201 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.476304 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.476573 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.476664 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.476906 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.477000 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.477228 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.477418 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.477555 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.477703 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.477863 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.477957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.478167 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.478270 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.478474 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.478575 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.478790 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.478883 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.479094 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.479193 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.479480 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.479702 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.480383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.480542 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.480699 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.480812 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.480930 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.481075 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.481176 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.481264 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.481463 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.481558 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.481772 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.481875 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.482091 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.482186 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.482400 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.482553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.482716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.482867 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.483025 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.483178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.483350 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.483502 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.483665 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.483829 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.483976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.484152 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.484301 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.484460 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.484563 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.484775 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.484988 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.485128 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.485240 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.485421 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.485591 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.485746 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.485930 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.486058 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.486277 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.486383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.486587 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.486680 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.486897 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.486997 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.487225 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.487397 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.487532 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.487626 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.487845 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.487951 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.488155 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.488300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.488468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.488628 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.488778 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.488942 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.489085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.489266 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.489436 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.489618 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.489725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.489921 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.490064 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.490228 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.490358 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.490540 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.490678 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.490847 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.490955 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.491154 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.491255 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.491478 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.491580 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.491785 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.491888 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.492100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.492192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.492407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.492509 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.492715 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.492820 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.493022 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.493115 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.493344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.493453 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.493666 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.493760 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.493974 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.494074 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.494294 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.494393 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.494600 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.494695 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.494908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.495000 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.495221 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.495334 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.495569 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.495715 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.495891 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.495987 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.496204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.496308 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.496512 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.496817 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.496918 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.497124 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.497225 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.497492 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.497600 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.497802 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.497895 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.498122 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.498223 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.498433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.498526 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.498747 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.498839 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.499065 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.499166 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.499384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.499483 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.499717 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.499863 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.500006 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.500112 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.500320 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.500468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.501329 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.501476 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.501594 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.501689 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.501782 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.501881 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.501881 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.501881 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.502137 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.502430 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.502547 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.502735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.502832 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.503043 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.503155 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.503344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.503439 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.503648 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.503741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.503958 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.504062 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.504281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.504386 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.504624 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.504734 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.504903 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.505008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.505212 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.505328 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.505542 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.505651 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.505847 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.505950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.506152 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.506276 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.506491 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.506594 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.506796 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.506897 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.507124 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.507217 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.507430 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.507525 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.507750 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.507901 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.508070 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.508172 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.508383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.508485 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.508697 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.508799 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.509011 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.509103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.509348 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.509462 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.509668 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.509762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.510123 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.510218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.510319 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.510405 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.510583 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.510768 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.511531 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.511766 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.511766 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.512037 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.512037 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.512327 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.512478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.512629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.512778 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.512919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.513059 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.513206 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.513372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.513533 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.513677 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.513833 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.513974 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.514115 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.514262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.514417 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.514567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.514725 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.514877 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.515020 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.515169 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.515328 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.515480 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.515633 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.515786 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.515947 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.516100 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.516245 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.516386 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.516537 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.516678 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.516825 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.516975 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.517128 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.517269 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.517505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.517603 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.517813 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.517908 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.518128 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.518273 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.518449 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.518583 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.518757 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.518874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.519065 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.519180 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.519378 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.519541 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.519687 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.519843 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.520113 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.520210 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.520307 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.520415 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.520584 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.520752 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.520909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.521071 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.521219 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.521347 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.521507 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.521649 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.521820 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.521961 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.522133 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.522382 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.522477 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.522701 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.522794 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.523019 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.523380 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.523592 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.523694 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.523904 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.524006 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.524215 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.524316 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.524531 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.524743 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.524860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.525061 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.525157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.525417 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.525515 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.525746 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.525839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.526073 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.526165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.526391 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.526494 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.526808 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.526913 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.527141 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.527243 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.527448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.527541 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.527754 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.527846 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.528066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.528258 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.528376 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.528588 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.528762 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.528912 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.529064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.529220 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.529380 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.529571 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.529732 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.529901 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.530073 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.530242 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.530396 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.530541 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.530731 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.530883 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.531098 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.531320 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.531418 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.531504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.531705 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.531840 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.532028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.532132 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.532346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.532441 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.532651 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.532745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.532972 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.533067 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.533278 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.533403 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.533605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.533711 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.533921 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.534047 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.534235 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.534381 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.534543 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.534719 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.534862 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.535081 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.535212 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.535362 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.535465 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.535677 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.535772 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.535988 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.536260 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.536368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.536570 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.536674 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.536898 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.537000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.537204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.537298 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.537532 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.537629 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.537837 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.537931 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.538148 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.538244 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.538454 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.538556 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.538757 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.538850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.539062 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.539180 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.539438 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.539564 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.539658 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.539745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.539949 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.540050 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.540308 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.540443 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.540633 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.540736 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.540945 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.541049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.541255 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.541405 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.541612 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.541717 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.541912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.542019 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.542227 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.542836 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.543044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.543227 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.543374 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.543502 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.543645 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.543861 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.543971 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.544181 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.544276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.544512 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.544608 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.544851 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.544945 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.545190 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.545404 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.545555 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.545708 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.545854 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.546046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.546184 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.546378 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.546514 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.546698 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.546833 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.547030 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.547160 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.547362 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.547492 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.547669 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.547804 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.547974 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.548131 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.548279 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.548429 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.548583 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.548817 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.548963 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.549095 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.549209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.549376 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.549510 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.549693 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.549814 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.550003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.550106 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.550317 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.550478 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.550628 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.550722 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.550959 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.551075 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.551268 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.551430 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.551579 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.551763 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.551928 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.552074 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.552230 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.552382 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.552545 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.552703 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.552857 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.552999 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.553153 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.553339 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.553493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.553649 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.553799 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.553948 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.554090 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.554231 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.554381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.554487 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.554626 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.554721 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.554940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.555034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.555251 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.555414 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.555560 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.555656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.555868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.555963 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.556184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.556482 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.556577 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.556675 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.556814 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.556989 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.557153 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.557759 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.557759 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.558064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.558155 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.558294 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.558400 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.558487 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.558640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.558827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.558979 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.559156 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.559259 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.559478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.559573 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.559796 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.559889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.560560 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.560698 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.560831 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.560920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.561022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.561109 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.561205 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.561293 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.561456 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.561598 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.561704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.561803 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.561973 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.562152 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.562304 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.562457 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.562621 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.562777 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.562928 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.563078 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.563227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.563369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.563511 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.563672 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.563855 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.564109 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.564262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.564405 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.564572 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.564720 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.564869 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.565011 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.565152 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.565293 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.565476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.565618 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.565762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.565905 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.566055 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.566214 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.566377 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.566526 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.566677 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.566830 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.566991 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.567140 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.567284 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.567425 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.567575 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.567717 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.567864 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.568016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.568157 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.568329 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.568467 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.568617 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.568765 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.569010 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.569150 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.569319 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.569434 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.569531 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.569628 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.569751 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.569922 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.570070 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.570253 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.570392 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.570565 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.570886 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.571001 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.571194 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.571288 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.571518 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.571700 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.571855 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.572016 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.572166 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.572265 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.572432 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.572539 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.572745 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.572838 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.573052 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.573146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.573402 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.574043 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.574316 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.574455 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.574763 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.574868 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.575084 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.575265 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.575403 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.575663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.575767 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.575958 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.576118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.576266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.576388 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.576530 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.576626 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.576829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.576941 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.577149 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.577264 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.577564 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.577718 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.577880 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.578073 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.578175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.578423 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.578526 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.578729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.578836 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.579060 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.579221 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.579384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.579486 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.579689 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.579791 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.580000 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.580094 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.580312 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.580406 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.580634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.580774 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.580952 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.581065 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.581232 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.581365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.581575 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.581796 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.581952 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.582100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.582273 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.582368 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.582470 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.582560 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.582773 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.582882 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.583087 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.583196 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.583398 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.583493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.583729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.583821 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.584037 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.584141 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.584348 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.584501 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.584657 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.584750 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.584972 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.585076 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.585279 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.585483 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.585612 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.585704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.585846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127618) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 04:34:37.585957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.586214 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.586529 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.586837 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.587238 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.587547 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.587867 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.588225 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.588539 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.588847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.589251 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.590690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.590690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.590690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.590690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.591741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.591741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.592733 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.594536 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.594883 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.596632 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.597000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.597376 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.597742 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.598099 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.598432 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.598760 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.599083 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.599426 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.599750 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.600076 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.600398 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.600722 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.601044 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.601387 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.601709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.602030 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.602349 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.602668 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.602989 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.603306 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.603624 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.603944 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.604271 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.604624 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.605057 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.605413 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.605739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.606065 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.606387 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.606703 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.607020 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.607339 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.607666 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.607999 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.608318 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.608647 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.609064 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.609413 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.609744 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.610071 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.610388 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.610716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.611047 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.611500 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.611829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.612150 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.612492 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.612841 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.613182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.613541 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.613855 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.614167 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.614481 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.614800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.615126 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.615444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.615755 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.616062 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.616377 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.616689 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.617000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.617338 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.617641 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.617955 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.618264 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.618571 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.618880 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.619187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.619493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.619801 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.620112 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.620973 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.621293 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.621625 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.621935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.622242 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.622582 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.622918 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.623237 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.623571 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.623889 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.624216 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.624533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.624863 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.625189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.625537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.625855 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.626193 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.626512 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.626830 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.627150 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.627464 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.627779 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.628124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.628459 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.628809 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.629104 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.629456 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.629787 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.630109 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.630428 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.630746 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.631080 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.631397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.631714 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.632029 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.632346 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.632670 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.632988 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.633322 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.633648 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.633970 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.634289 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.634620 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.634954 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.635267 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.635595 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.635924 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.636871 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.637198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.637568 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.637905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.638222 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.638541 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.638851 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 04:34:37.639098 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127617) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 04:34:37.654880 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO dbcounter [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] Registered counter for database nova_api Sep 06 04:34:37.675980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_db.sqlalchemy.engines [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:34:37.682726 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writer thread running {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:34:37.702000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO dbcounter [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] Registered counter for database nova_api Sep 06 04:34:37.722323 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_db.sqlalchemy.engines [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:34:37.729021 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writer thread running {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:34:37.740497 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.context [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b1fcff94-52a9-4308-8b15-a7ecd9f60a15(cell1) {{(pid=127618) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 04:34:37.744590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:34:37.745073 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:34:37.747377 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:34:37.748131 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:34:37.748588 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:34:37.750618 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:34:37.752595 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO dbcounter [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] Registered counter for database nova_cell0 Sep 06 04:34:37.756653 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO dbcounter [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] Registered counter for database nova_cell1 Sep 06 04:34:37.763926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_db.sqlalchemy.engines [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:34:37.765516 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_db.sqlalchemy.engines [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:34:37.772640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writer thread running {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:34:37.774282 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writer thread running {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:34:37.787457 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.context [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b1fcff94-52a9-4308-8b15-a7ecd9f60a15(cell1) {{(pid=127617) load_cells /opt/stack/nova/nova/context.py:464}} Sep 06 04:34:37.791876 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:34:37.792931 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:34:37.794656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:34:37.797464 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:34:37.797464 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:34:37.798003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:34:37.800083 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO dbcounter [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] Registered counter for database nova_cell0 Sep 06 04:34:37.804274 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO dbcounter [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] Registered counter for database nova_cell1 Sep 06 04:34:37.811714 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_db.sqlalchemy.engines [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:34:37.813605 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_db.sqlalchemy.engines [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:34:37.819559 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writer thread running {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:34:37.821833 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writer thread running {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:34:37.928270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO dbcounter [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] Registered counter for database nova_cell0 Sep 06 04:34:37.935122 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_db.sqlalchemy.engines [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127618) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:34:37.939781 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writer thread running {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:34:37.974204 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO dbcounter [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] Registered counter for database nova_cell0 Sep 06 04:34:37.981890 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_db.sqlalchemy.engines [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127617) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 04:34:37.986525 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writer thread running {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 04:34:38.263595 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: WARNING keystonemiddleware.auth_token [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 04:34:38.271222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: WARNING keystonemiddleware.auth_token [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 04:34:38.303112 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: WARNING keystonemiddleware.auth_token [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 04:34:38.310533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: WARNING keystonemiddleware.auth_token [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 04:34:38.633218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: WARNING keystonemiddleware.auth_token [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 04:34:38.639423 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: WARNING keystonemiddleware.auth_token [None req-b5d0080a-8e79-4473-a51d-fa7a1bd97c7c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 04:34:38.644818 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557418afd9c0 pid: 127618 (default app) Sep 06 04:34:38.658938 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: WARNING keystonemiddleware.auth_token [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 06 04:34:38.664920 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: WARNING keystonemiddleware.auth_token [None req-31983705-940a-4dd9-b64f-9437399a3a48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 06 04:34:38.670946 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557418afd9c0 pid: 127617 (default app) Sep 06 04:35:18.232604 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cad0edf8-4eb7-4f01-aeda-1b0286f2a219 tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] Calling method '.version_select at 0x7f31775a13a0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:18.274165 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:18.274165 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:18.274165 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:18.274506 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:19.778108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cad0edf8-4eb7-4f01-aeda-1b0286f2a219 tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/3df61657-aa05-45ad-9d44-dc74a14e0fbb" status: 200 len: 351 microversion: 2.1 time: 1.910316 Sep 06 04:35:19.778739 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 1/1] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:35:17 2022] GET /compute/v2.1/os-volumes/3df61657-aa05-45ad-9d44-dc74a14e0fbb => generated 351 bytes in 1914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:35:22.604156 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2e85ce2a-798c-45da-9ccc-1efd48d07c15 tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] Calling method '.version_select at 0x7f31775a03a0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:22.634756 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:22.641048 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:22.641048 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:22.641048 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:23.196061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2e85ce2a-798c-45da-9ccc-1efd48d07c15 tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/11f6c549-2b50-484f-877f-b34d85765f72" status: 200 len: 350 microversion: 2.1 time: 0.933388 Sep 06 04:35:23.197077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 1/2] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:35:22 2022] GET /compute/v2.1/os-volumes/11f6c549-2b50-484f-877f-b34d85765f72 => generated 350 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:35:25.585218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-05e36c3e-2def-414e-b178-a96a9c249b9b tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] Calling method '.version_select at 0x7f31773c0160>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:25.823412 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-05e36c3e-2def-414e-b178-a96a9c249b9b tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/2e7b02d5-1a83-4972-939f-fda743f079fe" status: 200 len: 350 microversion: 2.1 time: 0.242516 Sep 06 04:35:25.824001 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:35:25 2022] GET /compute/v2.1/os-volumes/2e7b02d5-1a83-4972-939f-fda743f079fe => generated 350 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:35:25.841889 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d5126c43-3504-4006-be65-d7f5f72f5f95 tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] Calling method '.version_select at 0x7f31773b83a0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:26.163337 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d5126c43-3504-4006-be65-d7f5f72f5f95 tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.328018 Sep 06 04:35:26.164509 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 2/4] 10.222.0.30 () {58 vars in 1134 bytes} [Tue Sep 6 04:35:25 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:26.184143 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0a32a972-1ca9-40a7-99cd-b444cfced026 tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] Calling method '.version_select at 0x7f31773c0280>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:26.357265 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0a32a972-1ca9-40a7-99cd-b444cfced026 tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.177813 Sep 06 04:35:26.357982 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 3/5] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Sep 6 04:35:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:35:26.373863 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ed2a54fe-f660-4f26-9ad8-d6e1530cc369 tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] Calling method '.version_select at 0x7f31773b80d0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:26.486018 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ed2a54fe-f660-4f26-9ad8-d6e1530cc369 tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.117761 Sep 06 04:35:26.494985 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 3/6] 10.222.0.30 () {58 vars in 1134 bytes} [Tue Sep 6 04:35:26 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:26.502994 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fcda185e-a87d-4748-802d-55a910f11a9b tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] Calling method '.version_select at 0x7f31773c09d0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:26.696192 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fcda185e-a87d-4748-802d-55a910f11a9b tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.198360 Sep 06 04:35:26.697765 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Sep 6 04:35:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:35:26.714809 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c7f3273b-a1c1-4dd6-9937-721d5e2362cb tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] Calling method '.version_select at 0x7f31773dc430>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:26.938036 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c7f3273b-a1c1-4dd6-9937-721d5e2362cb tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.225876 Sep 06 04:35:26.938036 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Sep 6 04:35:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:35:26.953210 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-aa5bec4d-e1bc-46c0-8f7b-da834ff1c92b tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] Calling method '.version_select at 0x7f31773db550>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:27.173661 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-aa5bec4d-e1bc-46c0-8f7b-da834ff1c92b tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.226047 Sep 06 04:35:27.174615 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 5/9] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Sep 6 04:35:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:27.189011 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-51803801-d2f9-4823-b8cf-26c6e9858478 tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] Calling method '.version_select at 0x7f317735f790>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:27.393635 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-51803801-d2f9-4823-b8cf-26c6e9858478 tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.208895 Sep 06 04:35:27.394857 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 5/10] 10.222.0.30 () {58 vars in 1188 bytes} [Tue Sep 6 04:35:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:35:27.414585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f94d12d5-3213-4005-89e3-e6943c50af93 tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] Calling method '.version_select at 0x7f31773db9d0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:27.612718 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f94d12d5-3213-4005-89e3-e6943c50af93 tempest-VolumesTestJSON-1138446915 tempest-VolumesTestJSON-1138446915-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.204167 Sep 06 04:35:27.613296 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 6/11] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Sep 6 04:35:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:30.146747 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-870f84d3-320e-42c5-b570-5308895bc979 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Action: 'create', calling method: .version_select at 0x7f31773dc280>, body: {"keypair": {"name": "tempest-keypair-633779473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrlnS6KepCJX9Lu9sy0hrWEn8y+a+NP+dvlMrh9IW1IBwpUU8nQ8Wj/kmoylURe/abm7edP9ePANhDMGzkTDBrDA4cBRIM9V42VWDF+ufRlU6Qbk3UhIuv2x6bMH2B0+g=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:35:30.255236 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-870f84d3-320e-42c5-b570-5308895bc979 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for project 3d04ba57221f42d684873d624dbfd283. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:35:30.280940 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-870f84d3-320e-42c5-b570-5308895bc979 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for user 5a0294ea40914bf290902307a787642d and project 3d04ba57221f42d684873d624dbfd283. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:35:30.460060 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-870f84d3-320e-42c5-b570-5308895bc979 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.433771 Sep 06 04:35:30.460743 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 6/12] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Sep 6 04:35:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:35:30.914234 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-109076381", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:35:31.193942 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] validate_networks() for [('06e43195-6270-4b08-b3f6-284307ad52d8', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:35:32.080100 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2e53b57b-7f14-47d5-ad9c-e7a1169bd232 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Action: 'create', calling method: .version_select at 0x7f317733b040>, body: {"keypair": {"name": "tempest-keypair-1166574110", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKw5UrNbAltUWv69F15gfb/+BUP3EyTMifBcBVbuA9lBj+G/U9u7Ow8E9FIBIhPrbbfRJkzwgvpp7rLaoGIY5+7jOCiqOfQ3d0p7RhysP6n9Wd+tOI0TAwVKth4EPmPaCQ=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:35:32.150603 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-2e53b57b-7f14-47d5-ad9c-e7a1169bd232 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Getting quotas for project 2388589a34d346f3b31b231a9dafe34d. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:35:32.168034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-2e53b57b-7f14-47d5-ad9c-e7a1169bd232 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Getting quotas for user 1ca147cfc97149dd87e533123a262cfd and project 2388589a34d346f3b31b231a9dafe34d. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:35:32.327621 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2e53b57b-7f14-47d5-ad9c-e7a1169bd232 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.334104 Sep 06 04:35:32.327621 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 7/13] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Sep 6 04:35:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 336 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 06 04:35:33.219009 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:35:33.219492 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:35:33.219984 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:35:33.220394 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:35:33.220809 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:35:33.284067 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:33.284790 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:33.286482 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:33.288900 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:33.289823 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:33.290733 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:33.354146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Getting quotas for project 7aa4ca550edd4876a4c6c56deedf9d70. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:35:33.366101 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Getting quotas for user dec1c17550b849dbadbc16e98530b455 and project 7aa4ca550edd4876a4c6c56deedf9d70. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:35:33.382740 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:35:33.390364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:35:33.665560 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-08eee663-5062-4242-84a5-55655f4ad61d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.834530 Sep 06 04:35:33.674049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1686037211", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "networks": [{"uuid": "9bcee315-88c0-4acf-82b7-0c166d7d1495"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:35:33.691982 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 7/14] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:35:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:35:33.703038 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-32c34269-f998-4bb1-a464-d8e3bded0652 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:33.706230 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-32c34269-f998-4bb1-a464-d8e3bded0652 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:33.801220 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] validate_networks() for [('9bcee315-88c0-4acf-82b7-0c166d7d1495', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:35:33.914778 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-32c34269-f998-4bb1-a464-d8e3bded0652 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:33.966437 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-32c34269-f998-4bb1-a464-d8e3bded0652 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1221 microversion: 2.1 time: 0.273196 Sep 06 04:35:33.980213 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 8/15] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:33 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1221 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:34.075960 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1610649065", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:35:34.240589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] validate_networks() for [('06e43195-6270-4b08-b3f6-284307ad52d8', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:35:35.127909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:35:35.128567 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:35:35.129182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:35:35.129938 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:35:35.130572 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:35:35.150827 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:35.162413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:35.163146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:35.164122 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:35.164741 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:35.165347 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:35.241888 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Getting quotas for project 7aa4ca550edd4876a4c6c56deedf9d70. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:35:35.264318 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Getting quotas for user dec1c17550b849dbadbc16e98530b455 and project 7aa4ca550edd4876a4c6c56deedf9d70. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:35:35.322094 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:35:35.325703 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:35:35.602915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ef1c5529-8504-4c71-b7fb-f3ffe9f862ab tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.538961 Sep 06 04:35:35.615041 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 9/16] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:35:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:35:35.627049 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-44921ff5-247c-4c50-bda1-1261eee59218 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:35.646359 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-44921ff5-247c-4c50-bda1-1261eee59218 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:35.804152 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-44921ff5-247c-4c50-bda1-1261eee59218 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:35.814339 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-44921ff5-247c-4c50-bda1-1261eee59218 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1222 microversion: 2.1 time: 0.190840 Sep 06 04:35:35.825342 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 10/17] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:35 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1222 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:35.876453 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:35:35.878871 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:35:35.878871 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:35:35.878871 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:35:35.878871 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:35:35.896171 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:35.896664 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:35.897116 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:35.897822 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:35.903206 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:35.905792 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:36.002863 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Getting quotas for project 96ba8ad37f17481a9691031fefbc3c80. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:35:36.014290 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Getting quotas for user 15eebbd8b1d44f4897acb266633998db and project 96ba8ad37f17481a9691031fefbc3c80. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:35:36.049436 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:35:36.060292 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:35:36.328428 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f09916d0-f8b4-4653-a6d1-c5cb6889ee8c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.791498 Sep 06 04:35:36.334714 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 8/18] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:35:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:35:36.339140 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4a0e9ef7-bf36-482a-8922-328f0375f313 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:36.340202 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4a0e9ef7-bf36-482a-8922-328f0375f313 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:36.410298 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1838523808", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c394cea-216c-4a1f-9277-2bb67bf6a21b"}], "security_groups": [{"name": "tempest-securitygroup--1351079892"}], "key_name": "tempest-keypair-633779473", "user_data": "}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:35:36.556991 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4a0e9ef7-bf36-482a-8922-328f0375f313 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:36.570620 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4a0e9ef7-bf36-482a-8922-328f0375f313 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1215 microversion: 2.1 time: 0.234847 Sep 06 04:35:36.572704 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 11/19] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:36 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1215 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:35:36.845823 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5670d799-6bc8-4dbd-9103-ba14d559d447 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:36.846433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5670d799-6bc8-4dbd-9103-ba14d559d447 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:36.957248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5670d799-6bc8-4dbd-9103-ba14d559d447 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:36.959826 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] validate_networks() for [('4c394cea-216c-4a1f-9277-2bb67bf6a21b', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:35:36.966147 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5670d799-6bc8-4dbd-9103-ba14d559d447 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1222 microversion: 2.1 time: 0.124133 Sep 06 04:35:36.968029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 12/20] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:36 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1222 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:35:37.605322 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d67fe8af-43da-41f5-99c4-20a0ce34ae1b tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:37.614166 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d67fe8af-43da-41f5-99c4-20a0ce34ae1b tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:37.729278 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d67fe8af-43da-41f5-99c4-20a0ce34ae1b tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:37.750820 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d67fe8af-43da-41f5-99c4-20a0ce34ae1b tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1215 microversion: 2.1 time: 0.153584 Sep 06 04:35:37.751596 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 13/21] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:37 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:37.914219 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:35:37.914971 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:35:37.919895 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:35:37.920627 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:35:37.921267 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:35:37.947430 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1446462263", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6861b199-7de9-4155-8c49-44122ab810f3"}], "security_groups": [{"name": "tempest-securitygroup--34582713"}], "key_name": "tempest-keypair-1166574110", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:35:37.970796 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:37.973086 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:37.973811 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:37.975716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:37.978632 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:37.979289 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:38.057275 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for project 3d04ba57221f42d684873d624dbfd283. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:35:38.067032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for user 5a0294ea40914bf290902307a787642d and project 3d04ba57221f42d684873d624dbfd283. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:35:38.108484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:35:38.111934 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:35:38.213293 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] validate_networks() for [('6861b199-7de9-4155-8c49-44122ab810f3', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:35:38.402594 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-024745f7-3e0e-4fe8-8a41-78477f325b33 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.998760 Sep 06 04:35:38.414368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 9/22] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:35:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 2012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 04:35:38.426357 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2725c44f-551a-45c6-9e2a-14ac680e3c77 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:38.435923 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2725c44f-551a-45c6-9e2a-14ac680e3c77 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:38.494021 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2725c44f-551a-45c6-9e2a-14ac680e3c77 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:38.494654 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2725c44f-551a-45c6-9e2a-14ac680e3c77 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:38.495705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2725c44f-551a-45c6-9e2a-14ac680e3c77 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:38.502717 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2725c44f-551a-45c6-9e2a-14ac680e3c77 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:38.508184 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2725c44f-551a-45c6-9e2a-14ac680e3c77 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:38.512945 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2725c44f-551a-45c6-9e2a-14ac680e3c77 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:38.983557 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2725c44f-551a-45c6-9e2a-14ac680e3c77 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:39.013932 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2725c44f-551a-45c6-9e2a-14ac680e3c77 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1218 microversion: 2.1 time: 0.597955 Sep 06 04:35:39.015034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 10/23] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:38 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1218 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:39.036928 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9e21c1ca-0241-4897-8d50-434ce9ad9bf8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:39.040968 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9e21c1ca-0241-4897-8d50-434ce9ad9bf8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:39.156343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9e21c1ca-0241-4897-8d50-434ce9ad9bf8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:39.171797 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9e21c1ca-0241-4897-8d50-434ce9ad9bf8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1241 microversion: 2.1 time: 0.144274 Sep 06 04:35:39.193996 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 11/24] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:39 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1241 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:39.204392 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8352c1ef-6923-4f3f-ad92-455d62561028 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:39.205930 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8352c1ef-6923-4f3f-ad92-455d62561028 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:39.223670 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8352c1ef-6923-4f3f-ad92-455d62561028 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:39.224463 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8352c1ef-6923-4f3f-ad92-455d62561028 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:39.225068 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8352c1ef-6923-4f3f-ad92-455d62561028 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:39.225971 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8352c1ef-6923-4f3f-ad92-455d62561028 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:39.226801 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8352c1ef-6923-4f3f-ad92-455d62561028 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:39.227377 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8352c1ef-6923-4f3f-ad92-455d62561028 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:39.343010 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8352c1ef-6923-4f3f-ad92-455d62561028 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:39.352771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8352c1ef-6923-4f3f-ad92-455d62561028 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1211 microversion: 2.1 time: 0.157118 Sep 06 04:35:39.358789 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 12/25] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:39 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1211 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:39.571478 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:35:39.572313 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:35:39.572975 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:35:39.573654 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:35:39.574338 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:35:39.589246 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:39.590392 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:39.590593 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:39.591580 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:39.592109 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:39.592823 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:39.660836 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Getting quotas for project 2388589a34d346f3b31b231a9dafe34d. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:35:39.682586 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Getting quotas for user 1ca147cfc97149dd87e533123a262cfd and project 2388589a34d346f3b31b231a9dafe34d. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:35:39.700818 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:35:39.703350 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:35:39.974593 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1ca6e9b0-0058-4f6d-a895-616ebfd5cb43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 2.039686 Sep 06 04:35:39.975616 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 14/26] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Sep 6 04:35:37 2022] POST /compute/v2.1/servers => generated 400 bytes in 2042 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 04:35:39.989581 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7f2ec6e5-8faf-4992-9370-9a75dbc063bd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:39.990239 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7f2ec6e5-8faf-4992-9370-9a75dbc063bd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:40.046653 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9fa23ccf-4445-4efd-be90-d690f35e9fd2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:40.050211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9fa23ccf-4445-4efd-be90-d690f35e9fd2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:40.063328 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9fa23ccf-4445-4efd-be90-d690f35e9fd2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:40.064084 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9fa23ccf-4445-4efd-be90-d690f35e9fd2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:40.064767 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9fa23ccf-4445-4efd-be90-d690f35e9fd2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:40.065726 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9fa23ccf-4445-4efd-be90-d690f35e9fd2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:40.066607 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9fa23ccf-4445-4efd-be90-d690f35e9fd2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:40.067199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9fa23ccf-4445-4efd-be90-d690f35e9fd2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:40.254661 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7f2ec6e5-8faf-4992-9370-9a75dbc063bd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:40.268270 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7f2ec6e5-8faf-4992-9370-9a75dbc063bd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:40.271957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7f2ec6e5-8faf-4992-9370-9a75dbc063bd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:40.275150 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7f2ec6e5-8faf-4992-9370-9a75dbc063bd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1282 microversion: 2.20 time: 0.291793 Sep 06 04:35:40.328820 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 13/27] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:35:39 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1282 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:35:40.352135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cd217697-b242-49db-9377-079db501a889 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:40.354050 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cd217697-b242-49db-9377-079db501a889 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:40.406820 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd217697-b242-49db-9377-079db501a889 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:40.406820 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd217697-b242-49db-9377-079db501a889 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:40.414405 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd217697-b242-49db-9377-079db501a889 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:40.415561 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd217697-b242-49db-9377-079db501a889 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:40.417625 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd217697-b242-49db-9377-079db501a889 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:40.422006 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd217697-b242-49db-9377-079db501a889 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:40.451211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9fa23ccf-4445-4efd-be90-d690f35e9fd2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:40.476677 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9fa23ccf-4445-4efd-be90-d690f35e9fd2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1282 microversion: 2.1 time: 0.440311 Sep 06 04:35:40.477737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 15/28] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:40 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1282 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:35:40.483222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-785efc8b-a200-4e6d-a098-b603b9ece149 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:40.486131 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-785efc8b-a200-4e6d-a098-b603b9ece149 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:40.493296 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-785efc8b-a200-4e6d-a098-b603b9ece149 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:40.493990 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-785efc8b-a200-4e6d-a098-b603b9ece149 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:40.494435 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-785efc8b-a200-4e6d-a098-b603b9ece149 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:40.495321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-785efc8b-a200-4e6d-a098-b603b9ece149 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:40.495773 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-785efc8b-a200-4e6d-a098-b603b9ece149 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:40.496620 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-785efc8b-a200-4e6d-a098-b603b9ece149 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:40.551766 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cd217697-b242-49db-9377-079db501a889 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:40.567315 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cd217697-b242-49db-9377-079db501a889 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1245 microversion: 2.1 time: 0.236952 Sep 06 04:35:40.568599 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 14/29] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:40 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1245 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:40.606903 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-785efc8b-a200-4e6d-a098-b603b9ece149 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:40.616410 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-785efc8b-a200-4e6d-a098-b603b9ece149 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1267 microversion: 2.1 time: 0.137458 Sep 06 04:35:40.617226 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 16/30] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:40 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:41.305286 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-784ff8c9-8a3d-475e-aa95-2ed47e10e497 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:41.305962 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-784ff8c9-8a3d-475e-aa95-2ed47e10e497 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:41.454839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-784ff8c9-8a3d-475e-aa95-2ed47e10e497 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:41.465039 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-784ff8c9-8a3d-475e-aa95-2ed47e10e497 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:41.469285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-784ff8c9-8a3d-475e-aa95-2ed47e10e497 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:41.474759 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-784ff8c9-8a3d-475e-aa95-2ed47e10e497 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1282 microversion: 2.20 time: 0.174280 Sep 06 04:35:41.476910 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 15/31] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:35:41 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1282 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:35:41.514411 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fd4cc1e1-87fc-4180-ac2c-52a5893aed36 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:41.514411 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fd4cc1e1-87fc-4180-ac2c-52a5893aed36 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:41.521840 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd4cc1e1-87fc-4180-ac2c-52a5893aed36 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:41.522337 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd4cc1e1-87fc-4180-ac2c-52a5893aed36 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:41.523144 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd4cc1e1-87fc-4180-ac2c-52a5893aed36 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:41.524301 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd4cc1e1-87fc-4180-ac2c-52a5893aed36 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:41.525001 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd4cc1e1-87fc-4180-ac2c-52a5893aed36 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:41.525682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd4cc1e1-87fc-4180-ac2c-52a5893aed36 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:41.602006 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-052b7a2e-e75a-4c39-a6cf-fb02b2ce0c17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:41.602241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-052b7a2e-e75a-4c39-a6cf-fb02b2ce0c17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:41.616802 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fd4cc1e1-87fc-4180-ac2c-52a5893aed36 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:41.625915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fd4cc1e1-87fc-4180-ac2c-52a5893aed36 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1280 microversion: 2.1 time: 0.123771 Sep 06 04:35:41.639979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-052b7a2e-e75a-4c39-a6cf-fb02b2ce0c17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:41.641197 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-052b7a2e-e75a-4c39-a6cf-fb02b2ce0c17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:41.643981 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-052b7a2e-e75a-4c39-a6cf-fb02b2ce0c17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:41.652300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 17/32] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:41 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1280 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:41.653567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-052b7a2e-e75a-4c39-a6cf-fb02b2ce0c17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:41.654499 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-052b7a2e-e75a-4c39-a6cf-fb02b2ce0c17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:41.655056 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-052b7a2e-e75a-4c39-a6cf-fb02b2ce0c17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:41.666308 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8cc5554c-9fbe-4bb8-b539-aceb32fd1bb9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:41.669633 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8cc5554c-9fbe-4bb8-b539-aceb32fd1bb9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:41.685475 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cc5554c-9fbe-4bb8-b539-aceb32fd1bb9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:41.685475 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cc5554c-9fbe-4bb8-b539-aceb32fd1bb9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:41.685696 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cc5554c-9fbe-4bb8-b539-aceb32fd1bb9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:41.686385 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cc5554c-9fbe-4bb8-b539-aceb32fd1bb9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:41.686909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cc5554c-9fbe-4bb8-b539-aceb32fd1bb9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:41.687237 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cc5554c-9fbe-4bb8-b539-aceb32fd1bb9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:41.816119 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8cc5554c-9fbe-4bb8-b539-aceb32fd1bb9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:41.826555 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8cc5554c-9fbe-4bb8-b539-aceb32fd1bb9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1285 microversion: 2.1 time: 0.172858 Sep 06 04:35:41.827127 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 18/33] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:41 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:41.946460 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-052b7a2e-e75a-4c39-a6cf-fb02b2ce0c17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:41.956992 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-052b7a2e-e75a-4c39-a6cf-fb02b2ce0c17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1293 microversion: 2.1 time: 0.359435 Sep 06 04:35:41.958087 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 16/34] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:41 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1293 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:35:42.514858 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-02447e8e-3c27-4669-8a0a-66139a2a79ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:42.538031 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-02447e8e-3c27-4669-8a0a-66139a2a79ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:42.538031 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02447e8e-3c27-4669-8a0a-66139a2a79ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:42.547659 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02447e8e-3c27-4669-8a0a-66139a2a79ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:42.549596 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02447e8e-3c27-4669-8a0a-66139a2a79ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:42.551911 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02447e8e-3c27-4669-8a0a-66139a2a79ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:42.561952 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02447e8e-3c27-4669-8a0a-66139a2a79ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:42.570337 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02447e8e-3c27-4669-8a0a-66139a2a79ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:42.653775 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8f53887d-6eab-4191-8b47-1348446f6efa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:42.655208 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8f53887d-6eab-4191-8b47-1348446f6efa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:42.677258 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f53887d-6eab-4191-8b47-1348446f6efa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:42.680349 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f53887d-6eab-4191-8b47-1348446f6efa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:42.684987 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f53887d-6eab-4191-8b47-1348446f6efa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:42.686807 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f53887d-6eab-4191-8b47-1348446f6efa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:42.690888 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f53887d-6eab-4191-8b47-1348446f6efa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:42.693920 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f53887d-6eab-4191-8b47-1348446f6efa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:42.757992 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-02447e8e-3c27-4669-8a0a-66139a2a79ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:42.786481 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-02447e8e-3c27-4669-8a0a-66139a2a79ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:42.789085 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-02447e8e-3c27-4669-8a0a-66139a2a79ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:42.804630 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-02447e8e-3c27-4669-8a0a-66139a2a79ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1286 microversion: 2.20 time: 0.302485 Sep 06 04:35:42.805250 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 19/35] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:35:42 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1286 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:35:42.877690 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-66af9209-257f-44a3-a4f3-dfebfd0ff736 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:42.878300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-66af9209-257f-44a3-a4f3-dfebfd0ff736 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:42.906274 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66af9209-257f-44a3-a4f3-dfebfd0ff736 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:42.906753 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66af9209-257f-44a3-a4f3-dfebfd0ff736 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:42.907198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66af9209-257f-44a3-a4f3-dfebfd0ff736 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:42.907935 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66af9209-257f-44a3-a4f3-dfebfd0ff736 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:42.908467 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66af9209-257f-44a3-a4f3-dfebfd0ff736 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:42.908892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66af9209-257f-44a3-a4f3-dfebfd0ff736 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:43.227353 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-66af9209-257f-44a3-a4f3-dfebfd0ff736 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:43.242118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-66af9209-257f-44a3-a4f3-dfebfd0ff736 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1273 microversion: 2.1 time: 0.365786 Sep 06 04:35:43.252520 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 20/36] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:42 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1273 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:43.300285 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ac358f35-eb54-4b1f-b3eb-c07a6d4ce4a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:43.303873 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ac358f35-eb54-4b1f-b3eb-c07a6d4ce4a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:43.328840 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac358f35-eb54-4b1f-b3eb-c07a6d4ce4a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:43.329361 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac358f35-eb54-4b1f-b3eb-c07a6d4ce4a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:43.329809 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac358f35-eb54-4b1f-b3eb-c07a6d4ce4a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:43.330792 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac358f35-eb54-4b1f-b3eb-c07a6d4ce4a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:43.331467 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac358f35-eb54-4b1f-b3eb-c07a6d4ce4a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:43.335409 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac358f35-eb54-4b1f-b3eb-c07a6d4ce4a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:43.761395 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ac358f35-eb54-4b1f-b3eb-c07a6d4ce4a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:43.778504 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ac358f35-eb54-4b1f-b3eb-c07a6d4ce4a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1311 microversion: 2.1 time: 0.495334 Sep 06 04:35:43.782097 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 21/37] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:43 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1311 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:43.816557 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8f53887d-6eab-4191-8b47-1348446f6efa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:43.841948 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8f53887d-6eab-4191-8b47-1348446f6efa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 1.178160 Sep 06 04:35:43.842375 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a88f39f0-624f-4fc0-b4d0-64d0c3fba266 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:43.842375 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a88f39f0-624f-4fc0-b4d0-64d0c3fba266 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:43.859072 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 17/38] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:42 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:43.860725 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a88f39f0-624f-4fc0-b4d0-64d0c3fba266 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:43.861282 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a88f39f0-624f-4fc0-b4d0-64d0c3fba266 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:43.861748 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a88f39f0-624f-4fc0-b4d0-64d0c3fba266 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:43.868618 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a88f39f0-624f-4fc0-b4d0-64d0c3fba266 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:43.874959 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a88f39f0-624f-4fc0-b4d0-64d0c3fba266 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:43.877257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a88f39f0-624f-4fc0-b4d0-64d0c3fba266 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:44.127872 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a88f39f0-624f-4fc0-b4d0-64d0c3fba266 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:44.150373 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a88f39f0-624f-4fc0-b4d0-64d0c3fba266 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:44.152552 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a88f39f0-624f-4fc0-b4d0-64d0c3fba266 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:44.153788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a88f39f0-624f-4fc0-b4d0-64d0c3fba266 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1334 microversion: 2.20 time: 0.322627 Sep 06 04:35:44.162245 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 22/39] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:35:43 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1334 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:35:44.299136 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1816454a-483c-4caa-bed3-52e62e81ff2d tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:44.299921 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1816454a-483c-4caa-bed3-52e62e81ff2d tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:44.316458 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1816454a-483c-4caa-bed3-52e62e81ff2d tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:44.322174 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1816454a-483c-4caa-bed3-52e62e81ff2d tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:44.322174 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1816454a-483c-4caa-bed3-52e62e81ff2d tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:44.322174 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1816454a-483c-4caa-bed3-52e62e81ff2d tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:44.322174 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1816454a-483c-4caa-bed3-52e62e81ff2d tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:44.332299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1816454a-483c-4caa-bed3-52e62e81ff2d tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:44.820847 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ff99996f-b56b-4815-ae00-3f94460ee008 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:44.826538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ff99996f-b56b-4815-ae00-3f94460ee008 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:44.850944 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff99996f-b56b-4815-ae00-3f94460ee008 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:44.851713 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff99996f-b56b-4815-ae00-3f94460ee008 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:44.852350 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff99996f-b56b-4815-ae00-3f94460ee008 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:44.853293 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff99996f-b56b-4815-ae00-3f94460ee008 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:44.853941 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff99996f-b56b-4815-ae00-3f94460ee008 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:44.854757 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff99996f-b56b-4815-ae00-3f94460ee008 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:45.286007 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ff99996f-b56b-4815-ae00-3f94460ee008 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:45.304419 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ff99996f-b56b-4815-ae00-3f94460ee008 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1299 microversion: 2.1 time: 0.494143 Sep 06 04:35:45.321737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 23/40] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:44 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1299 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:45.322265 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b5b597e2-72e7-4377-90a2-03612d09498c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:45.323436 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b5b597e2-72e7-4377-90a2-03612d09498c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:45.334300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5b597e2-72e7-4377-90a2-03612d09498c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:45.341036 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5b597e2-72e7-4377-90a2-03612d09498c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:45.341719 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5b597e2-72e7-4377-90a2-03612d09498c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:45.342656 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5b597e2-72e7-4377-90a2-03612d09498c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:45.344349 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5b597e2-72e7-4377-90a2-03612d09498c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:45.346285 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b5b597e2-72e7-4377-90a2-03612d09498c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:45.695069 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1816454a-483c-4caa-bed3-52e62e81ff2d tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:45.715919 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1816454a-483c-4caa-bed3-52e62e81ff2d tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 1.428257 Sep 06 04:35:45.737055 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 18/41] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:44 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:45.744627 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b3821818-5014-44bd-aa3c-e0e2674ff2f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:45.745688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b3821818-5014-44bd-aa3c-e0e2674ff2f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:45.757411 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b3821818-5014-44bd-aa3c-e0e2674ff2f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:45.758960 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b3821818-5014-44bd-aa3c-e0e2674ff2f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:45.759633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b3821818-5014-44bd-aa3c-e0e2674ff2f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:45.761534 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b3821818-5014-44bd-aa3c-e0e2674ff2f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:45.762222 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b3821818-5014-44bd-aa3c-e0e2674ff2f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:45.762999 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b3821818-5014-44bd-aa3c-e0e2674ff2f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:45.969112 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b5b597e2-72e7-4377-90a2-03612d09498c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:45.978302 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b5b597e2-72e7-4377-90a2-03612d09498c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.669564 Sep 06 04:35:45.979030 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 24/42] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:45 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:46.122878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b3821818-5014-44bd-aa3c-e0e2674ff2f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:46.143402 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b3821818-5014-44bd-aa3c-e0e2674ff2f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:46.157737 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b3821818-5014-44bd-aa3c-e0e2674ff2f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:46.161965 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b3821818-5014-44bd-aa3c-e0e2674ff2f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1340 microversion: 2.20 time: 0.422180 Sep 06 04:35:46.178835 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 19/43] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:35:45 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1340 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:35:46.338752 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-72d9d4f9-b725-49e3-8333-06b6b772efb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:46.339846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-72d9d4f9-b725-49e3-8333-06b6b772efb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:46.349669 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72d9d4f9-b725-49e3-8333-06b6b772efb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:46.349669 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72d9d4f9-b725-49e3-8333-06b6b772efb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:46.353071 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72d9d4f9-b725-49e3-8333-06b6b772efb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:46.360075 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72d9d4f9-b725-49e3-8333-06b6b772efb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:46.360075 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72d9d4f9-b725-49e3-8333-06b6b772efb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:46.360075 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72d9d4f9-b725-49e3-8333-06b6b772efb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:46.497269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-72d9d4f9-b725-49e3-8333-06b6b772efb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:46.509742 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-72d9d4f9-b725-49e3-8333-06b6b772efb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1299 microversion: 2.1 time: 0.175424 Sep 06 04:35:46.510923 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 25/44] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:46 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1299 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:46.748818 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-172d193b-f7a4-4265-89c2-f65b945e2d89 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:46.748818 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-172d193b-f7a4-4265-89c2-f65b945e2d89 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:46.761718 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-172d193b-f7a4-4265-89c2-f65b945e2d89 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:46.762228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-172d193b-f7a4-4265-89c2-f65b945e2d89 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:46.765968 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-172d193b-f7a4-4265-89c2-f65b945e2d89 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:46.789287 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-172d193b-f7a4-4265-89c2-f65b945e2d89 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:46.790371 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-172d193b-f7a4-4265-89c2-f65b945e2d89 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:46.792488 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-172d193b-f7a4-4265-89c2-f65b945e2d89 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:47.005487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-daf8a4d7-a3e0-4280-952a-8df72b968eaa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:47.005487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-daf8a4d7-a3e0-4280-952a-8df72b968eaa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:47.015862 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-daf8a4d7-a3e0-4280-952a-8df72b968eaa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:47.020342 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-daf8a4d7-a3e0-4280-952a-8df72b968eaa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:47.020342 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-daf8a4d7-a3e0-4280-952a-8df72b968eaa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:47.020342 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-daf8a4d7-a3e0-4280-952a-8df72b968eaa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:47.020342 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-daf8a4d7-a3e0-4280-952a-8df72b968eaa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:47.020712 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-daf8a4d7-a3e0-4280-952a-8df72b968eaa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:48.029736 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:48.069795 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-172d193b-f7a4-4265-89c2-f65b945e2d89 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:48.104147 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-172d193b-f7a4-4265-89c2-f65b945e2d89 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 1.361883 Sep 06 04:35:48.125477 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 20/45] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:46 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:48.140883 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7a70dde9-3d87-4d88-a0b0-25f46d5e95b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:48.147845 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7a70dde9-3d87-4d88-a0b0-25f46d5e95b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:48.157242 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a70dde9-3d87-4d88-a0b0-25f46d5e95b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:48.158017 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a70dde9-3d87-4d88-a0b0-25f46d5e95b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:48.158447 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a70dde9-3d87-4d88-a0b0-25f46d5e95b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:48.159136 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a70dde9-3d87-4d88-a0b0-25f46d5e95b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:48.159856 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a70dde9-3d87-4d88-a0b0-25f46d5e95b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:48.160537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a70dde9-3d87-4d88-a0b0-25f46d5e95b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:48.247291 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-daf8a4d7-a3e0-4280-952a-8df72b968eaa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:48.247291 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-daf8a4d7-a3e0-4280-952a-8df72b968eaa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 1.218680 Sep 06 04:35:48.247291 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 26/46] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:46 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:35:48.247291 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-27ad37b6-5456-4f64-96bf-ea6153f6d7d7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:48.248636 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-27ad37b6-5456-4f64-96bf-ea6153f6d7d7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:48.248636 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27ad37b6-5456-4f64-96bf-ea6153f6d7d7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:48.248636 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27ad37b6-5456-4f64-96bf-ea6153f6d7d7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:48.248636 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27ad37b6-5456-4f64-96bf-ea6153f6d7d7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:48.248913 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27ad37b6-5456-4f64-96bf-ea6153f6d7d7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:48.248913 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27ad37b6-5456-4f64-96bf-ea6153f6d7d7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:48.248913 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27ad37b6-5456-4f64-96bf-ea6153f6d7d7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:48.300327 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7a70dde9-3d87-4d88-a0b0-25f46d5e95b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:48.332805 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7a70dde9-3d87-4d88-a0b0-25f46d5e95b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:48.338205 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7a70dde9-3d87-4d88-a0b0-25f46d5e95b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:48.342031 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7a70dde9-3d87-4d88-a0b0-25f46d5e95b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1340 microversion: 2.20 time: 0.216961 Sep 06 04:35:48.343578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 21/47] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:35:48 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1340 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:35:48.466939 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-27ad37b6-5456-4f64-96bf-ea6153f6d7d7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:48.477721 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-27ad37b6-5456-4f64-96bf-ea6153f6d7d7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1299 microversion: 2.1 time: 0.256420 Sep 06 04:35:48.481405 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 27/48] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:48 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1299 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:48.523193 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-06c08fcd-a82f-4ffb-a47d-f24a74026a18 req-f03b5e8f-7b0d-448c-8a2d-e7a408c4d5cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7855d2a-a4a4-44fa-9200-c2b74b273458", "tag": "7dd08f26-fca9-44dc-9f2f-a94635106365"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:35:48.534971 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-06c08fcd-a82f-4ffb-a47d-f24a74026a18 req-f03b5e8f-7b0d-448c-8a2d-e7a408c4d5cb service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:48.535894 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-06c08fcd-a82f-4ffb-a47d-f24a74026a18 req-f03b5e8f-7b0d-448c-8a2d-e7a408c4d5cb service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:48.537029 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-06c08fcd-a82f-4ffb-a47d-f24a74026a18 req-f03b5e8f-7b0d-448c-8a2d-e7a408c4d5cb service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:48.566197 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-06c08fcd-a82f-4ffb-a47d-f24a74026a18 req-f03b5e8f-7b0d-448c-8a2d-e7a408c4d5cb service nova] Creating event network-changed:7dd08f26-fca9-44dc-9f2f-a94635106365 for instance c7855d2a-a4a4-44fa-9200-c2b74b273458 on hv-cinder-85600 Sep 06 04:35:48.567128 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-06c08fcd-a82f-4ffb-a47d-f24a74026a18 req-f03b5e8f-7b0d-448c-8a2d-e7a408c4d5cb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 04:35:48.567874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-06c08fcd-a82f-4ffb-a47d-f24a74026a18 req-f03b5e8f-7b0d-448c-8a2d-e7a408c4d5cb service nova] Acquired lock "compute-rpcapi-router" {{(pid=127617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 04:35:48.570152 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ad3cb09-41ac-4308-ac0c-145f3930cb40 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:48.570959 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ad3cb09-41ac-4308-ac0c-145f3930cb40 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:48.571823 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ad3cb09-41ac-4308-ac0c-145f3930cb40 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:48.572813 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ad3cb09-41ac-4308-ac0c-145f3930cb40 None None] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:48.573604 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ad3cb09-41ac-4308-ac0c-145f3930cb40 None None] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:48.574374 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ad3cb09-41ac-4308-ac0c-145f3930cb40 None None] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:48.584574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.compute.rpcapi [None req-2ad3cb09-41ac-4308-ac0c-145f3930cb40 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 04:35:48.585819 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ad3cb09-41ac-4308-ac0c-145f3930cb40 None None] Releasing lock "compute-rpcapi-router" {{(pid=127617) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 04:35:48.603527 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2ad3cb09-41ac-4308-ac0c-145f3930cb40 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.258416 Sep 06 04:35:48.605481 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 22/49] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:35:49.134359 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b353814c-27ad-4331-890d-4825b85599a6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:49.137965 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b353814c-27ad-4331-890d-4825b85599a6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:49.146977 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b353814c-27ad-4331-890d-4825b85599a6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:49.148085 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b353814c-27ad-4331-890d-4825b85599a6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:49.150078 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b353814c-27ad-4331-890d-4825b85599a6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:49.151118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b353814c-27ad-4331-890d-4825b85599a6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:49.152106 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b353814c-27ad-4331-890d-4825b85599a6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:49.152745 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b353814c-27ad-4331-890d-4825b85599a6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:49.253475 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5070a1c3-71b9-4a86-9027-b1be6404aa0d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:49.254761 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5070a1c3-71b9-4a86-9027-b1be6404aa0d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:49.279604 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5070a1c3-71b9-4a86-9027-b1be6404aa0d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:49.279604 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5070a1c3-71b9-4a86-9027-b1be6404aa0d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:49.280283 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5070a1c3-71b9-4a86-9027-b1be6404aa0d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:49.281300 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5070a1c3-71b9-4a86-9027-b1be6404aa0d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:49.284895 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5070a1c3-71b9-4a86-9027-b1be6404aa0d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:49.285603 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5070a1c3-71b9-4a86-9027-b1be6404aa0d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:49.566921 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b353814c-27ad-4331-890d-4825b85599a6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:49.581343 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b353814c-27ad-4331-890d-4825b85599a6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.453805 Sep 06 04:35:49.581963 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 28/50] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:49 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:49.586880 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-284c0338-6ed8-4f86-a275-98fe20ca477f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:49.587481 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-284c0338-6ed8-4f86-a275-98fe20ca477f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:49.613028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:49.613028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284c0338-6ed8-4f86-a275-98fe20ca477f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:49.613028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284c0338-6ed8-4f86-a275-98fe20ca477f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:49.613028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284c0338-6ed8-4f86-a275-98fe20ca477f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:49.613393 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284c0338-6ed8-4f86-a275-98fe20ca477f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:49.613393 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284c0338-6ed8-4f86-a275-98fe20ca477f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:49.631645 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284c0338-6ed8-4f86-a275-98fe20ca477f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:49.680047 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:49.703402 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=28 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:49.846064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-284c0338-6ed8-4f86-a275-98fe20ca477f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:49.876686 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-284c0338-6ed8-4f86-a275-98fe20ca477f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:49.878930 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-284c0338-6ed8-4f86-a275-98fe20ca477f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:49.886329 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-284c0338-6ed8-4f86-a275-98fe20ca477f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1340 microversion: 2.20 time: 0.297405 Sep 06 04:35:49.886329 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 29/51] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:35:49 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1340 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:35:49.894903 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-eacf9034-7a84-4764-a959-fe2f5d06d39d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:49.896421 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-eacf9034-7a84-4764-a959-fe2f5d06d39d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:49.906787 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eacf9034-7a84-4764-a959-fe2f5d06d39d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:49.907538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eacf9034-7a84-4764-a959-fe2f5d06d39d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:49.908200 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eacf9034-7a84-4764-a959-fe2f5d06d39d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:49.909782 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eacf9034-7a84-4764-a959-fe2f5d06d39d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:49.910960 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eacf9034-7a84-4764-a959-fe2f5d06d39d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:49.914985 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eacf9034-7a84-4764-a959-fe2f5d06d39d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:49.951244 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:50.145512 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5070a1c3-71b9-4a86-9027-b1be6404aa0d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:50.145512 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5070a1c3-71b9-4a86-9027-b1be6404aa0d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.812328 Sep 06 04:35:50.145512 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 23/52] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:49 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:50.380005 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-88ebd631-73cb-44bd-8b13-d45fe4aff468 req-cd976328-1684-40b2-9e39-3458f9bda22f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e4b2e8-d999-4a8f-90f7-cb565ec5c716", "tag": "6f3d018c-b1db-426d-bceb-91b09c7660bd"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:35:50.434415 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-88ebd631-73cb-44bd-8b13-d45fe4aff468 req-cd976328-1684-40b2-9e39-3458f9bda22f service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:50.439285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-88ebd631-73cb-44bd-8b13-d45fe4aff468 req-cd976328-1684-40b2-9e39-3458f9bda22f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:50.441422 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-88ebd631-73cb-44bd-8b13-d45fe4aff468 req-cd976328-1684-40b2-9e39-3458f9bda22f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:50.524183 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-88ebd631-73cb-44bd-8b13-d45fe4aff468 req-cd976328-1684-40b2-9e39-3458f9bda22f service nova] Creating event network-changed:6f3d018c-b1db-426d-bceb-91b09c7660bd for instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 on hv-cinder-85600 Sep 06 04:35:50.549845 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-88ebd631-73cb-44bd-8b13-d45fe4aff468 req-cd976328-1684-40b2-9e39-3458f9bda22f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.485808 Sep 06 04:35:50.560523 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 24/53] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:35:50.618741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-23ec2979-6cc1-4801-8b8e-bef1977ceb52 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:50.619868 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-23ec2979-6cc1-4801-8b8e-bef1977ceb52 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:50.630438 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23ec2979-6cc1-4801-8b8e-bef1977ceb52 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:50.631398 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23ec2979-6cc1-4801-8b8e-bef1977ceb52 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:50.631982 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23ec2979-6cc1-4801-8b8e-bef1977ceb52 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:50.633419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23ec2979-6cc1-4801-8b8e-bef1977ceb52 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:50.634088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23ec2979-6cc1-4801-8b8e-bef1977ceb52 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:50.635202 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23ec2979-6cc1-4801-8b8e-bef1977ceb52 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:50.836056 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-eacf9034-7a84-4764-a959-fe2f5d06d39d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:50.849278 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-eacf9034-7a84-4764-a959-fe2f5d06d39d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.961130 Sep 06 04:35:50.850334 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 30/54] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:49 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:50.913696 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1a139309-4d2c-4099-a849-03c0c3e27e60 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:50.914813 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1a139309-4d2c-4099-a849-03c0c3e27e60 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:50.929004 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a139309-4d2c-4099-a849-03c0c3e27e60 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:50.929647 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a139309-4d2c-4099-a849-03c0c3e27e60 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:50.930131 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a139309-4d2c-4099-a849-03c0c3e27e60 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:50.930918 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a139309-4d2c-4099-a849-03c0c3e27e60 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:50.931423 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a139309-4d2c-4099-a849-03c0c3e27e60 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:50.931949 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a139309-4d2c-4099-a849-03c0c3e27e60 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:51.315331 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-23ec2979-6cc1-4801-8b8e-bef1977ceb52 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:51.346508 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-23ec2979-6cc1-4801-8b8e-bef1977ceb52 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.740217 Sep 06 04:35:51.355239 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 25/55] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:50 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:51.371312 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e4a6c459-5e97-4322-8dec-6b420015365d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:51.371947 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e4a6c459-5e97-4322-8dec-6b420015365d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:51.411187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4a6c459-5e97-4322-8dec-6b420015365d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:51.413515 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4a6c459-5e97-4322-8dec-6b420015365d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:51.415797 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4a6c459-5e97-4322-8dec-6b420015365d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:51.421293 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4a6c459-5e97-4322-8dec-6b420015365d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:51.425252 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4a6c459-5e97-4322-8dec-6b420015365d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:51.437477 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e4a6c459-5e97-4322-8dec-6b420015365d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:51.496762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=26 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:51.832093 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1a139309-4d2c-4099-a849-03c0c3e27e60 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:51.880724 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1a139309-4d2c-4099-a849-03c0c3e27e60 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:51.889293 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1a139309-4d2c-4099-a849-03c0c3e27e60 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:51.897128 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1a139309-4d2c-4099-a849-03c0c3e27e60 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.981958 Sep 06 04:35:51.898805 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 31/56] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:35:50 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:35:51.907599 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f78814a2-84af-46cd-96bc-edc46b6d68f3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:51.912307 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f78814a2-84af-46cd-96bc-edc46b6d68f3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:51.937657 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f78814a2-84af-46cd-96bc-edc46b6d68f3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:51.943487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f78814a2-84af-46cd-96bc-edc46b6d68f3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:51.944142 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f78814a2-84af-46cd-96bc-edc46b6d68f3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:51.950621 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f78814a2-84af-46cd-96bc-edc46b6d68f3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:51.955716 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f78814a2-84af-46cd-96bc-edc46b6d68f3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:51.956472 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f78814a2-84af-46cd-96bc-edc46b6d68f3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:52.358711 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e4a6c459-5e97-4322-8dec-6b420015365d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:52.360451 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f78814a2-84af-46cd-96bc-edc46b6d68f3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:52.373178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f78814a2-84af-46cd-96bc-edc46b6d68f3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.470679 Sep 06 04:35:52.373810 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 32/57] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:51 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:52.375653 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e4a6c459-5e97-4322-8dec-6b420015365d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 1.018213 Sep 06 04:35:52.389866 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 26/58] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:51 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:52.398292 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b545ca05-e948-4b95-9202-f7d0c0f24809 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:52.399606 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b545ca05-e948-4b95-9202-f7d0c0f24809 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:52.431330 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b545ca05-e948-4b95-9202-f7d0c0f24809 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:52.431831 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b545ca05-e948-4b95-9202-f7d0c0f24809 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:52.432355 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b545ca05-e948-4b95-9202-f7d0c0f24809 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:52.433563 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b545ca05-e948-4b95-9202-f7d0c0f24809 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:52.434236 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b545ca05-e948-4b95-9202-f7d0c0f24809 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:52.434683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b545ca05-e948-4b95-9202-f7d0c0f24809 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:52.959305 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-47cfde62-5c1f-4d6e-b883-7243ac02998a req-a6b4e985-5e16-47c3-888f-7bbce8dedea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed927594-12ef-48af-b170-5b88f8ecb0ec", "tag": "831811de-3ef7-415e-be56-fafeee2815c2"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:35:52.959305 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:52.959305 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-47cfde62-5c1f-4d6e-b883-7243ac02998a req-a6b4e985-5e16-47c3-888f-7bbce8dedea1 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:52.959305 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-47cfde62-5c1f-4d6e-b883-7243ac02998a req-a6b4e985-5e16-47c3-888f-7bbce8dedea1 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:52.962541 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-47cfde62-5c1f-4d6e-b883-7243ac02998a req-a6b4e985-5e16-47c3-888f-7bbce8dedea1 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:52.962808 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b545ca05-e948-4b95-9202-f7d0c0f24809 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:52.962808 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b545ca05-e948-4b95-9202-f7d0c0f24809 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.499480 Sep 06 04:35:52.962808 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 33/59] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:52 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:52.963442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-47cfde62-5c1f-4d6e-b883-7243ac02998a req-a6b4e985-5e16-47c3-888f-7bbce8dedea1 service nova] Creating event network-changed:831811de-3ef7-415e-be56-fafeee2815c2 for instance ed927594-12ef-48af-b170-5b88f8ecb0ec on hv-cinder-85600 Sep 06 04:35:52.963442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-47cfde62-5c1f-4d6e-b883-7243ac02998a req-a6b4e985-5e16-47c3-888f-7bbce8dedea1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063860 Sep 06 04:35:52.963442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 27/60] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:35:52.965154 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b07208f4-5151-474c-a0ec-8b89720c39ec tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:52.965154 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b07208f4-5151-474c-a0ec-8b89720c39ec tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:52.965154 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b07208f4-5151-474c-a0ec-8b89720c39ec tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:52.965154 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b07208f4-5151-474c-a0ec-8b89720c39ec tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:52.965794 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b07208f4-5151-474c-a0ec-8b89720c39ec tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:52.965794 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b07208f4-5151-474c-a0ec-8b89720c39ec tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:52.965794 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b07208f4-5151-474c-a0ec-8b89720c39ec tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:52.965794 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b07208f4-5151-474c-a0ec-8b89720c39ec tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:53.267801 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b07208f4-5151-474c-a0ec-8b89720c39ec tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:53.295491 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b07208f4-5151-474c-a0ec-8b89720c39ec tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:53.297858 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b07208f4-5151-474c-a0ec-8b89720c39ec tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:53.299062 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b07208f4-5151-474c-a0ec-8b89720c39ec tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.374717 Sep 06 04:35:53.300598 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 34/61] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:35:52 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:35:53.406002 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ebffdb6d-adea-4e12-ab96-de998b52f9e4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:53.407189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ebffdb6d-adea-4e12-ab96-de998b52f9e4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:53.418358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2528a203-0c52-4669-9765-70cd13780544 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:53.419137 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2528a203-0c52-4669-9765-70cd13780544 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:53.447127 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebffdb6d-adea-4e12-ab96-de998b52f9e4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:53.449301 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2528a203-0c52-4669-9765-70cd13780544 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:53.449905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebffdb6d-adea-4e12-ab96-de998b52f9e4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:53.456758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2528a203-0c52-4669-9765-70cd13780544 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:53.457012 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebffdb6d-adea-4e12-ab96-de998b52f9e4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:53.457170 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2528a203-0c52-4669-9765-70cd13780544 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:53.457170 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2528a203-0c52-4669-9765-70cd13780544 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:53.457550 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebffdb6d-adea-4e12-ab96-de998b52f9e4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:53.460539 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebffdb6d-adea-4e12-ab96-de998b52f9e4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:53.466241 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2528a203-0c52-4669-9765-70cd13780544 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:53.467350 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2528a203-0c52-4669-9765-70cd13780544 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:53.470477 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebffdb6d-adea-4e12-ab96-de998b52f9e4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:54.031384 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2528a203-0c52-4669-9765-70cd13780544 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:54.058926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2528a203-0c52-4669-9765-70cd13780544 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.647685 Sep 06 04:35:54.063319 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 35/62] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:53 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:35:54.086826 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-915da5d1-91ed-4554-8a63-bd0458fdcc71 req-4f0f060e-87ff-4dba-910f-d7545410add5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "655e54ca-b46d-40ea-a544-c796990772d7", "tag": "f88cebc5-b6a7-4ea8-9133-58a12f404543"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:35:54.128646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-915da5d1-91ed-4554-8a63-bd0458fdcc71 req-4f0f060e-87ff-4dba-910f-d7545410add5 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:54.129231 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-915da5d1-91ed-4554-8a63-bd0458fdcc71 req-4f0f060e-87ff-4dba-910f-d7545410add5 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:54.129959 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-915da5d1-91ed-4554-8a63-bd0458fdcc71 req-4f0f060e-87ff-4dba-910f-d7545410add5 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:54.179862 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-915da5d1-91ed-4554-8a63-bd0458fdcc71 req-4f0f060e-87ff-4dba-910f-d7545410add5 service nova] Creating event network-changed:f88cebc5-b6a7-4ea8-9133-58a12f404543 for instance 655e54ca-b46d-40ea-a544-c796990772d7 on hv-cinder-85600 Sep 06 04:35:54.183807 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-915da5d1-91ed-4554-8a63-bd0458fdcc71 req-4f0f060e-87ff-4dba-910f-d7545410add5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127618) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 06 04:35:54.186351 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-915da5d1-91ed-4554-8a63-bd0458fdcc71 req-4f0f060e-87ff-4dba-910f-d7545410add5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127618) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 06 04:35:54.197673 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79af04fe-1cb7-439b-9e74-9b9b17d487b5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:54.199363 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79af04fe-1cb7-439b-9e74-9b9b17d487b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:54.200120 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79af04fe-1cb7-439b-9e74-9b9b17d487b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:54.201091 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79af04fe-1cb7-439b-9e74-9b9b17d487b5 None None] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:54.201784 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79af04fe-1cb7-439b-9e74-9b9b17d487b5 None None] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:54.205648 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79af04fe-1cb7-439b-9e74-9b9b17d487b5 None None] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:54.214880 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.compute.rpcapi [None req-79af04fe-1cb7-439b-9e74-9b9b17d487b5 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 06 04:35:54.216465 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79af04fe-1cb7-439b-9e74-9b9b17d487b5 None None] Releasing lock "compute-rpcapi-router" {{(pid=127618) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 06 04:35:54.242768 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-79af04fe-1cb7-439b-9e74-9b9b17d487b5 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169878 Sep 06 04:35:54.242768 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 36/63] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:35:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:35:54.247228 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a8127e5f-6eb1-4f23-b714-9cfab1641e26 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:54.248443 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a8127e5f-6eb1-4f23-b714-9cfab1641e26 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:54.256433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8127e5f-6eb1-4f23-b714-9cfab1641e26 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:54.257423 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8127e5f-6eb1-4f23-b714-9cfab1641e26 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:54.258190 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8127e5f-6eb1-4f23-b714-9cfab1641e26 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:54.259220 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8127e5f-6eb1-4f23-b714-9cfab1641e26 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:54.259905 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8127e5f-6eb1-4f23-b714-9cfab1641e26 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:54.261285 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8127e5f-6eb1-4f23-b714-9cfab1641e26 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:54.325522 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ebffdb6d-adea-4e12-ab96-de998b52f9e4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:54.356037 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ebffdb6d-adea-4e12-ab96-de998b52f9e4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.961503 Sep 06 04:35:54.357852 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 28/64] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:53 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:54.380469 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-99615ec1-5ee1-4dc6-993b-043a945dc929 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:54.380469 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-99615ec1-5ee1-4dc6-993b-043a945dc929 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:54.385257 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99615ec1-5ee1-4dc6-993b-043a945dc929 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:54.388972 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99615ec1-5ee1-4dc6-993b-043a945dc929 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:54.391645 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99615ec1-5ee1-4dc6-993b-043a945dc929 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:54.393503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99615ec1-5ee1-4dc6-993b-043a945dc929 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:54.394848 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99615ec1-5ee1-4dc6-993b-043a945dc929 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:54.396026 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-99615ec1-5ee1-4dc6-993b-043a945dc929 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:54.792503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-99615ec1-5ee1-4dc6-993b-043a945dc929 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:54.823775 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-99615ec1-5ee1-4dc6-993b-043a945dc929 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:54.838333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a8127e5f-6eb1-4f23-b714-9cfab1641e26 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:54.840223 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-99615ec1-5ee1-4dc6-993b-043a945dc929 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:54.850504 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a8127e5f-6eb1-4f23-b714-9cfab1641e26 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.609156 Sep 06 04:35:54.855624 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 37/65] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:54 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:54.890204 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-99615ec1-5ee1-4dc6-993b-043a945dc929 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.513312 Sep 06 04:35:54.894137 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 29/66] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:35:54 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:35:55.089070 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-56179b4c-e532-4970-b58b-2a8eb760b3f2 req-6842bd0a-ec59-46c0-b268-42cf5130d1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53238a8f-2601-4952-acd2-4dcb02761c12", "tag": "19322183-60e8-44ac-b690-7448dfce3250"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:35:55.089070 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-56179b4c-e532-4970-b58b-2a8eb760b3f2 req-6842bd0a-ec59-46c0-b268-42cf5130d1f5 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:55.089070 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-56179b4c-e532-4970-b58b-2a8eb760b3f2 req-6842bd0a-ec59-46c0-b268-42cf5130d1f5 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:55.089070 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-56179b4c-e532-4970-b58b-2a8eb760b3f2 req-6842bd0a-ec59-46c0-b268-42cf5130d1f5 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:55.090935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1f30520e-5de8-4817-ab50-08ebdeb64d7f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:55.090935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1f30520e-5de8-4817-ab50-08ebdeb64d7f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:55.097708 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-56179b4c-e532-4970-b58b-2a8eb760b3f2 req-6842bd0a-ec59-46c0-b268-42cf5130d1f5 service nova] Creating event network-changed:19322183-60e8-44ac-b690-7448dfce3250 for instance 53238a8f-2601-4952-acd2-4dcb02761c12 on hv-cinder-85600 Sep 06 04:35:55.117839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f30520e-5de8-4817-ab50-08ebdeb64d7f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:55.117839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f30520e-5de8-4817-ab50-08ebdeb64d7f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:55.117839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f30520e-5de8-4817-ab50-08ebdeb64d7f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:55.118259 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-56179b4c-e532-4970-b58b-2a8eb760b3f2 req-6842bd0a-ec59-46c0-b268-42cf5130d1f5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083780 Sep 06 04:35:55.118353 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f30520e-5de8-4817-ab50-08ebdeb64d7f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:55.118428 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 38/67] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:35:55.118540 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f30520e-5de8-4817-ab50-08ebdeb64d7f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:55.118540 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f30520e-5de8-4817-ab50-08ebdeb64d7f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:55.175653 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:55.381403 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d2e8aac9-75a9-4585-90dc-e3909930f7d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:55.382148 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d2e8aac9-75a9-4585-90dc-e3909930f7d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:55.404818 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2e8aac9-75a9-4585-90dc-e3909930f7d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:55.405364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2e8aac9-75a9-4585-90dc-e3909930f7d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:55.405761 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2e8aac9-75a9-4585-90dc-e3909930f7d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:55.406598 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2e8aac9-75a9-4585-90dc-e3909930f7d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:55.406902 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2e8aac9-75a9-4585-90dc-e3909930f7d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:55.407319 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2e8aac9-75a9-4585-90dc-e3909930f7d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:55.466613 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1f30520e-5de8-4817-ab50-08ebdeb64d7f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:55.484662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1f30520e-5de8-4817-ab50-08ebdeb64d7f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.399565 Sep 06 04:35:55.515790 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 30/68] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:55 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:55.674018 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d2e8aac9-75a9-4585-90dc-e3909930f7d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:55.684553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d2e8aac9-75a9-4585-90dc-e3909930f7d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.308774 Sep 06 04:35:55.685176 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 39/69] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:55 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:55.883813 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7dbc8bd7-f7c2-454a-8cc6-909b532bd74c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:55.885236 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7dbc8bd7-f7c2-454a-8cc6-909b532bd74c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:55.898400 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dbc8bd7-f7c2-454a-8cc6-909b532bd74c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:55.904824 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dbc8bd7-f7c2-454a-8cc6-909b532bd74c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:55.905686 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dbc8bd7-f7c2-454a-8cc6-909b532bd74c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:55.906893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dbc8bd7-f7c2-454a-8cc6-909b532bd74c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:55.925096 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a472c004-a041-49cb-8475-5cb11beee0cc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:55.933463 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dbc8bd7-f7c2-454a-8cc6-909b532bd74c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:55.933624 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a472c004-a041-49cb-8475-5cb11beee0cc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:55.933731 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7dbc8bd7-f7c2-454a-8cc6-909b532bd74c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:55.939583 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a472c004-a041-49cb-8475-5cb11beee0cc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:55.940716 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a472c004-a041-49cb-8475-5cb11beee0cc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:55.941371 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a472c004-a041-49cb-8475-5cb11beee0cc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:55.942766 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a472c004-a041-49cb-8475-5cb11beee0cc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:55.943677 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a472c004-a041-49cb-8475-5cb11beee0cc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:55.944988 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a472c004-a041-49cb-8475-5cb11beee0cc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:56.289053 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a472c004-a041-49cb-8475-5cb11beee0cc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:56.304568 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a472c004-a041-49cb-8475-5cb11beee0cc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:56.306861 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a472c004-a041-49cb-8475-5cb11beee0cc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:56.309906 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a472c004-a041-49cb-8475-5cb11beee0cc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.389121 Sep 06 04:35:56.312655 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 40/70] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:35:55 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:35:56.511830 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7dbc8bd7-f7c2-454a-8cc6-909b532bd74c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:56.513694 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-181a1959-6486-494c-af83-297dbb2408f6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:56.521806 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-181a1959-6486-494c-af83-297dbb2408f6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:56.521806 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-181a1959-6486-494c-af83-297dbb2408f6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:56.521806 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-181a1959-6486-494c-af83-297dbb2408f6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:56.521806 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-181a1959-6486-494c-af83-297dbb2408f6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:56.522331 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-181a1959-6486-494c-af83-297dbb2408f6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:56.522331 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-181a1959-6486-494c-af83-297dbb2408f6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:56.522766 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-181a1959-6486-494c-af83-297dbb2408f6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:56.524684 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7dbc8bd7-f7c2-454a-8cc6-909b532bd74c tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.645699 Sep 06 04:35:56.526250 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 31/71] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:55 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:56.669086 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-181a1959-6486-494c-af83-297dbb2408f6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:56.676775 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-181a1959-6486-494c-af83-297dbb2408f6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.167738 Sep 06 04:35:56.682699 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 41/72] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:56 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:56.709487 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b65139cb-e811-4a59-84ae-40ff02b5ed8a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:56.719662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b65139cb-e811-4a59-84ae-40ff02b5ed8a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:56.719662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b65139cb-e811-4a59-84ae-40ff02b5ed8a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:56.719662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b65139cb-e811-4a59-84ae-40ff02b5ed8a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:56.719662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b65139cb-e811-4a59-84ae-40ff02b5ed8a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:56.720202 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b65139cb-e811-4a59-84ae-40ff02b5ed8a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:56.720202 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b65139cb-e811-4a59-84ae-40ff02b5ed8a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:56.720202 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b65139cb-e811-4a59-84ae-40ff02b5ed8a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:56.853335 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b65139cb-e811-4a59-84ae-40ff02b5ed8a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:56.861545 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b65139cb-e811-4a59-84ae-40ff02b5ed8a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.156820 Sep 06 04:35:56.862106 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 32/73] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:56 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:57.341574 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c8f39c65-4fdf-47c9-b78d-02fcd0b88e5b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:57.342184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c8f39c65-4fdf-47c9-b78d-02fcd0b88e5b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:57.348180 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c8f39c65-4fdf-47c9-b78d-02fcd0b88e5b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:57.348659 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c8f39c65-4fdf-47c9-b78d-02fcd0b88e5b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:57.349193 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c8f39c65-4fdf-47c9-b78d-02fcd0b88e5b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:57.349965 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c8f39c65-4fdf-47c9-b78d-02fcd0b88e5b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:57.350415 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c8f39c65-4fdf-47c9-b78d-02fcd0b88e5b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:57.350834 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c8f39c65-4fdf-47c9-b78d-02fcd0b88e5b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:57.536122 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c8f39c65-4fdf-47c9-b78d-02fcd0b88e5b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:57.547879 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c8f39c65-4fdf-47c9-b78d-02fcd0b88e5b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:57.551232 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c8f39c65-4fdf-47c9-b78d-02fcd0b88e5b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:57.553161 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c8f39c65-4fdf-47c9-b78d-02fcd0b88e5b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.216046 Sep 06 04:35:57.553330 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-00d1e29d-4532-4d3c-b0f2-2240f51972c6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:57.554088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-00d1e29d-4532-4d3c-b0f2-2240f51972c6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:57.554886 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 42/74] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:35:57 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:35:57.560966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00d1e29d-4532-4d3c-b0f2-2240f51972c6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:57.573772 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00d1e29d-4532-4d3c-b0f2-2240f51972c6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:57.573772 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00d1e29d-4532-4d3c-b0f2-2240f51972c6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:57.573772 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00d1e29d-4532-4d3c-b0f2-2240f51972c6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:57.573772 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00d1e29d-4532-4d3c-b0f2-2240f51972c6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:57.574051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00d1e29d-4532-4d3c-b0f2-2240f51972c6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:57.701636 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-21e8222a-5073-4069-a99e-4e892ddc78c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:57.702431 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-21e8222a-5073-4069-a99e-4e892ddc78c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:57.708644 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-21e8222a-5073-4069-a99e-4e892ddc78c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:57.709347 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-21e8222a-5073-4069-a99e-4e892ddc78c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:57.709867 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-21e8222a-5073-4069-a99e-4e892ddc78c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:57.710658 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-21e8222a-5073-4069-a99e-4e892ddc78c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:57.711175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-21e8222a-5073-4069-a99e-4e892ddc78c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:57.711662 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-21e8222a-5073-4069-a99e-4e892ddc78c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:57.742696 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-00d1e29d-4532-4d3c-b0f2-2240f51972c6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:57.753636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-00d1e29d-4532-4d3c-b0f2-2240f51972c6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.209584 Sep 06 04:35:57.758178 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 33/75] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:57 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:35:57.884464 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5f19971d-fb60-409d-bd86-fad576c948f0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:57.885171 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5f19971d-fb60-409d-bd86-fad576c948f0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:57.891487 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f19971d-fb60-409d-bd86-fad576c948f0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:57.891966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f19971d-fb60-409d-bd86-fad576c948f0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:57.892576 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f19971d-fb60-409d-bd86-fad576c948f0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:57.893452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f19971d-fb60-409d-bd86-fad576c948f0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:57.893907 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f19971d-fb60-409d-bd86-fad576c948f0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:57.894328 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f19971d-fb60-409d-bd86-fad576c948f0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:57.916075 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-21e8222a-5073-4069-a99e-4e892ddc78c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:57.931557 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-21e8222a-5073-4069-a99e-4e892ddc78c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.235358 Sep 06 04:35:57.948586 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 43/76] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:57 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:35:58.032487 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5f19971d-fb60-409d-bd86-fad576c948f0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:58.040074 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5f19971d-fb60-409d-bd86-fad576c948f0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.159992 Sep 06 04:35:58.040639 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 34/77] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:57 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:35:58.581104 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4b32cb53-a01d-4fa9-9fd7-76ed254e3b35 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:58.581740 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4b32cb53-a01d-4fa9-9fd7-76ed254e3b35 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:58.591576 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b32cb53-a01d-4fa9-9fd7-76ed254e3b35 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:58.596820 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b32cb53-a01d-4fa9-9fd7-76ed254e3b35 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:58.596820 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b32cb53-a01d-4fa9-9fd7-76ed254e3b35 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:58.596820 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b32cb53-a01d-4fa9-9fd7-76ed254e3b35 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:58.596820 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b32cb53-a01d-4fa9-9fd7-76ed254e3b35 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:58.597174 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4b32cb53-a01d-4fa9-9fd7-76ed254e3b35 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:58.785691 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f17a1e88-ce63-4082-816e-735c0a2176a3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:58.786308 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f17a1e88-ce63-4082-816e-735c0a2176a3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:58.791010 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4b32cb53-a01d-4fa9-9fd7-76ed254e3b35 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:58.797499 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f17a1e88-ce63-4082-816e-735c0a2176a3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:58.797983 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f17a1e88-ce63-4082-816e-735c0a2176a3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:58.798427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f17a1e88-ce63-4082-816e-735c0a2176a3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:58.803764 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4b32cb53-a01d-4fa9-9fd7-76ed254e3b35 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:58.805187 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4b32cb53-a01d-4fa9-9fd7-76ed254e3b35 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:58.806339 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4b32cb53-a01d-4fa9-9fd7-76ed254e3b35 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.229074 Sep 06 04:35:58.806866 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 44/78] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:35:58 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:35:58.808124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f17a1e88-ce63-4082-816e-735c0a2176a3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:58.808973 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f17a1e88-ce63-4082-816e-735c0a2176a3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:58.809587 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f17a1e88-ce63-4082-816e-735c0a2176a3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:58.956622 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-85fb899d-bb0e-47d1-80c6-81a2266fe06c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:58.957630 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-85fb899d-bb0e-47d1-80c6-81a2266fe06c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:58.961119 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f17a1e88-ce63-4082-816e-735c0a2176a3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:58.971216 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f17a1e88-ce63-4082-816e-735c0a2176a3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.195498 Sep 06 04:35:58.974692 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85fb899d-bb0e-47d1-80c6-81a2266fe06c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:58.975110 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85fb899d-bb0e-47d1-80c6-81a2266fe06c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:58.976248 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 35/79] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:58 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:35:58.976811 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85fb899d-bb0e-47d1-80c6-81a2266fe06c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:58.977537 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85fb899d-bb0e-47d1-80c6-81a2266fe06c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:58.978173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85fb899d-bb0e-47d1-80c6-81a2266fe06c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:58.978766 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85fb899d-bb0e-47d1-80c6-81a2266fe06c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:59.063478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-01913e99-5897-4b04-ac07-dd01614b8e9c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:59.064082 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-01913e99-5897-4b04-ac07-dd01614b8e9c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:59.070405 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01913e99-5897-4b04-ac07-dd01614b8e9c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:59.070915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01913e99-5897-4b04-ac07-dd01614b8e9c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:59.071569 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01913e99-5897-4b04-ac07-dd01614b8e9c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:59.072270 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01913e99-5897-4b04-ac07-dd01614b8e9c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:59.072812 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01913e99-5897-4b04-ac07-dd01614b8e9c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:59.074206 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-01913e99-5897-4b04-ac07-dd01614b8e9c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:59.131093 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-85fb899d-bb0e-47d1-80c6-81a2266fe06c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:59.141908 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-85fb899d-bb0e-47d1-80c6-81a2266fe06c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.190185 Sep 06 04:35:59.142720 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 45/80] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:58 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:35:59.260765 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-01913e99-5897-4b04-ac07-dd01614b8e9c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:59.260765 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:35:59.267898 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-01913e99-5897-4b04-ac07-dd01614b8e9c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.208349 Sep 06 04:35:59.280662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 36/81] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:59 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:35:59.832082 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-636ef059-c3d4-40bf-af41-9cf35fa74f17 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:35:59.832690 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-636ef059-c3d4-40bf-af41-9cf35fa74f17 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:35:59.839780 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-636ef059-c3d4-40bf-af41-9cf35fa74f17 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:59.844173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-636ef059-c3d4-40bf-af41-9cf35fa74f17 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:59.844173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-636ef059-c3d4-40bf-af41-9cf35fa74f17 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:59.844173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-636ef059-c3d4-40bf-af41-9cf35fa74f17 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:35:59.844173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-636ef059-c3d4-40bf-af41-9cf35fa74f17 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:35:59.844856 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-636ef059-c3d4-40bf-af41-9cf35fa74f17 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:35:59.994282 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-636ef059-c3d4-40bf-af41-9cf35fa74f17 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:35:59.999623 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-20a151a6-4609-46f3-b9df-d5fb30446ca7 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:00.000190 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-20a151a6-4609-46f3-b9df-d5fb30446ca7 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:00.002919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-636ef059-c3d4-40bf-af41-9cf35fa74f17 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:00.004340 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-636ef059-c3d4-40bf-af41-9cf35fa74f17 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:00.005481 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-636ef059-c3d4-40bf-af41-9cf35fa74f17 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.177213 Sep 06 04:36:00.006246 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 46/82] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:35:59 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:36:00.021212 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-20a151a6-4609-46f3-b9df-d5fb30446ca7 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:00.037291 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-20a151a6-4609-46f3-b9df-d5fb30446ca7 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:00.037705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-20a151a6-4609-46f3-b9df-d5fb30446ca7 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:00.038441 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-20a151a6-4609-46f3-b9df-d5fb30446ca7 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:00.039050 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-20a151a6-4609-46f3-b9df-d5fb30446ca7 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:00.039473 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-20a151a6-4609-46f3-b9df-d5fb30446ca7 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:00.165996 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-19eeabb6-ff38-4244-a756-39656db4dfee tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:00.167048 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-19eeabb6-ff38-4244-a756-39656db4dfee tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:00.174715 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-19eeabb6-ff38-4244-a756-39656db4dfee tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:00.175411 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-19eeabb6-ff38-4244-a756-39656db4dfee tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:00.176105 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-19eeabb6-ff38-4244-a756-39656db4dfee tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:00.176876 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-19eeabb6-ff38-4244-a756-39656db4dfee tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:00.177429 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-19eeabb6-ff38-4244-a756-39656db4dfee tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:00.177919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-19eeabb6-ff38-4244-a756-39656db4dfee tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:00.181601 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-20a151a6-4609-46f3-b9df-d5fb30446ca7 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:00.201644 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-20a151a6-4609-46f3-b9df-d5fb30446ca7 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.199234 Sep 06 04:36:00.201644 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 37/83] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:35:59 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:00.299016 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ba0ee757-8e7b-4e11-8c6e-decb10c31a76 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:00.299016 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ba0ee757-8e7b-4e11-8c6e-decb10c31a76 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:00.303095 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ba0ee757-8e7b-4e11-8c6e-decb10c31a76 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:00.303978 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ba0ee757-8e7b-4e11-8c6e-decb10c31a76 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:00.304691 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ba0ee757-8e7b-4e11-8c6e-decb10c31a76 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:00.305605 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ba0ee757-8e7b-4e11-8c6e-decb10c31a76 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:00.306350 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ba0ee757-8e7b-4e11-8c6e-decb10c31a76 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:00.306912 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ba0ee757-8e7b-4e11-8c6e-decb10c31a76 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:00.351642 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-19eeabb6-ff38-4244-a756-39656db4dfee tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:00.364266 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-19eeabb6-ff38-4244-a756-39656db4dfee tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.202124 Sep 06 04:36:00.365190 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 47/84] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:00 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:00.465251 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ba0ee757-8e7b-4e11-8c6e-decb10c31a76 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:00.472994 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ba0ee757-8e7b-4e11-8c6e-decb10c31a76 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.185585 Sep 06 04:36:00.476095 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 38/85] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:00 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:01.048257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-eee30590-7552-4efe-82d3-3e546957092f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:01.048785 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-eee30590-7552-4efe-82d3-3e546957092f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:01.054957 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eee30590-7552-4efe-82d3-3e546957092f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:01.055504 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eee30590-7552-4efe-82d3-3e546957092f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:01.055992 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eee30590-7552-4efe-82d3-3e546957092f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:01.056739 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eee30590-7552-4efe-82d3-3e546957092f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:01.058439 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eee30590-7552-4efe-82d3-3e546957092f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:01.059176 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eee30590-7552-4efe-82d3-3e546957092f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:01.063925 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:36:01.215737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-eee30590-7552-4efe-82d3-3e546957092f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:01.225849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e2f282ae-3fdc-47da-9096-1d56f65e73a0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:01.225849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e2f282ae-3fdc-47da-9096-1d56f65e73a0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:01.226809 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-eee30590-7552-4efe-82d3-3e546957092f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:01.230408 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2f282ae-3fdc-47da-9096-1d56f65e73a0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:01.230553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-eee30590-7552-4efe-82d3-3e546957092f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:01.231178 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2f282ae-3fdc-47da-9096-1d56f65e73a0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:01.231659 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-eee30590-7552-4efe-82d3-3e546957092f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.191692 Sep 06 04:36:01.231917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2f282ae-3fdc-47da-9096-1d56f65e73a0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:01.232760 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2f282ae-3fdc-47da-9096-1d56f65e73a0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:01.233371 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2f282ae-3fdc-47da-9096-1d56f65e73a0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:01.233978 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2f282ae-3fdc-47da-9096-1d56f65e73a0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:01.266474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 48/86] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:36:01 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:36:01.392068 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b624d2b3-8c35-40b4-8cb8-b317bb3a9973 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:01.392673 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b624d2b3-8c35-40b4-8cb8-b317bb3a9973 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:01.401664 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e2f282ae-3fdc-47da-9096-1d56f65e73a0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:01.406147 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b624d2b3-8c35-40b4-8cb8-b317bb3a9973 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:01.406642 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b624d2b3-8c35-40b4-8cb8-b317bb3a9973 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:01.407164 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b624d2b3-8c35-40b4-8cb8-b317bb3a9973 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:01.407768 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b624d2b3-8c35-40b4-8cb8-b317bb3a9973 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:01.408218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b624d2b3-8c35-40b4-8cb8-b317bb3a9973 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:01.408635 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b624d2b3-8c35-40b4-8cb8-b317bb3a9973 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:01.418085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e2f282ae-3fdc-47da-9096-1d56f65e73a0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.200141 Sep 06 04:36:01.418984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 39/87] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:01 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:01.504201 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-06ebbb2a-e27a-4bab-8186-b92a15ba9af4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:01.504201 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-06ebbb2a-e27a-4bab-8186-b92a15ba9af4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:01.505746 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06ebbb2a-e27a-4bab-8186-b92a15ba9af4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:01.506265 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06ebbb2a-e27a-4bab-8186-b92a15ba9af4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:01.506709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06ebbb2a-e27a-4bab-8186-b92a15ba9af4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:01.507405 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06ebbb2a-e27a-4bab-8186-b92a15ba9af4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:01.507860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06ebbb2a-e27a-4bab-8186-b92a15ba9af4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:01.508282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06ebbb2a-e27a-4bab-8186-b92a15ba9af4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:01.550097 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b624d2b3-8c35-40b4-8cb8-b317bb3a9973 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:01.564159 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b624d2b3-8c35-40b4-8cb8-b317bb3a9973 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.175844 Sep 06 04:36:01.567496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 49/88] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:01 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:01.658540 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-06ebbb2a-e27a-4bab-8186-b92a15ba9af4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:01.666416 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-06ebbb2a-e27a-4bab-8186-b92a15ba9af4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.173522 Sep 06 04:36:01.667004 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 40/89] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:01 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:02.261993 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-71d8674f-f457-4697-946d-2db462e81fe1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:02.263017 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-71d8674f-f457-4697-946d-2db462e81fe1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:02.268758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71d8674f-f457-4697-946d-2db462e81fe1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:02.269220 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71d8674f-f457-4697-946d-2db462e81fe1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:02.269671 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71d8674f-f457-4697-946d-2db462e81fe1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:02.270350 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71d8674f-f457-4697-946d-2db462e81fe1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:02.270798 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71d8674f-f457-4697-946d-2db462e81fe1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:02.271219 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71d8674f-f457-4697-946d-2db462e81fe1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:02.413622 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-71d8674f-f457-4697-946d-2db462e81fe1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:02.416919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-71d8674f-f457-4697-946d-2db462e81fe1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:02.418525 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-71d8674f-f457-4697-946d-2db462e81fe1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:02.419634 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-71d8674f-f457-4697-946d-2db462e81fe1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.162436 Sep 06 04:36:02.420191 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 50/90] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:36:02 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:36:02.441622 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8fa10984-3fb1-4c5b-b7ca-c25c43b36bfb tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:02.442270 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8fa10984-3fb1-4c5b-b7ca-c25c43b36bfb tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:02.455218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fa10984-3fb1-4c5b-b7ca-c25c43b36bfb tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:02.456087 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fa10984-3fb1-4c5b-b7ca-c25c43b36bfb tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:02.456677 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fa10984-3fb1-4c5b-b7ca-c25c43b36bfb tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:02.457569 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fa10984-3fb1-4c5b-b7ca-c25c43b36bfb tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:02.458175 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fa10984-3fb1-4c5b-b7ca-c25c43b36bfb tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:02.458750 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fa10984-3fb1-4c5b-b7ca-c25c43b36bfb tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:02.594184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1eb4569e-31b5-48cd-9d58-efca8416c3e9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:02.594926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1eb4569e-31b5-48cd-9d58-efca8416c3e9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:02.600924 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1eb4569e-31b5-48cd-9d58-efca8416c3e9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:02.601462 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1eb4569e-31b5-48cd-9d58-efca8416c3e9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:02.601867 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1eb4569e-31b5-48cd-9d58-efca8416c3e9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:02.602771 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1eb4569e-31b5-48cd-9d58-efca8416c3e9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:02.603212 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1eb4569e-31b5-48cd-9d58-efca8416c3e9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:02.605192 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1eb4569e-31b5-48cd-9d58-efca8416c3e9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:02.639695 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8fa10984-3fb1-4c5b-b7ca-c25c43b36bfb tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:02.647672 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8fa10984-3fb1-4c5b-b7ca-c25c43b36bfb tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.210191 Sep 06 04:36:02.648847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 41/91] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:02 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:02.688702 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7810a88b-8fd8-4a71-943d-645ed5dfb7c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:02.689814 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7810a88b-8fd8-4a71-943d-645ed5dfb7c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:02.696103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7810a88b-8fd8-4a71-943d-645ed5dfb7c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:02.696580 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7810a88b-8fd8-4a71-943d-645ed5dfb7c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:02.697007 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7810a88b-8fd8-4a71-943d-645ed5dfb7c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:02.698274 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7810a88b-8fd8-4a71-943d-645ed5dfb7c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:02.698709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7810a88b-8fd8-4a71-943d-645ed5dfb7c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:02.699277 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7810a88b-8fd8-4a71-943d-645ed5dfb7c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:02.750712 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1eb4569e-31b5-48cd-9d58-efca8416c3e9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:02.759751 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1eb4569e-31b5-48cd-9d58-efca8416c3e9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.172181 Sep 06 04:36:02.760948 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 51/92] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:02 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:02.854441 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7810a88b-8fd8-4a71-943d-645ed5dfb7c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:02.863643 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7810a88b-8fd8-4a71-943d-645ed5dfb7c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.178495 Sep 06 04:36:02.864431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 42/93] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:02 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:03.445553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-abf20c78-fbc5-4665-92a5-c8d6f07bf992 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:03.446076 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-abf20c78-fbc5-4665-92a5-c8d6f07bf992 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:03.452585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abf20c78-fbc5-4665-92a5-c8d6f07bf992 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:03.453120 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abf20c78-fbc5-4665-92a5-c8d6f07bf992 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:03.453623 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abf20c78-fbc5-4665-92a5-c8d6f07bf992 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:03.454296 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abf20c78-fbc5-4665-92a5-c8d6f07bf992 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:03.454772 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abf20c78-fbc5-4665-92a5-c8d6f07bf992 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:03.455188 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abf20c78-fbc5-4665-92a5-c8d6f07bf992 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:03.591136 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-abf20c78-fbc5-4665-92a5-c8d6f07bf992 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:03.600867 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-abf20c78-fbc5-4665-92a5-c8d6f07bf992 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:03.602436 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-abf20c78-fbc5-4665-92a5-c8d6f07bf992 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:03.603562 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-abf20c78-fbc5-4665-92a5-c8d6f07bf992 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.162044 Sep 06 04:36:03.606423 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 52/94] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:36:03 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:36:03.671185 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1e9f31c8-2436-47e0-8c6a-a239155371d5 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:03.671796 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1e9f31c8-2436-47e0-8c6a-a239155371d5 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:03.678400 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e9f31c8-2436-47e0-8c6a-a239155371d5 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:03.678930 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e9f31c8-2436-47e0-8c6a-a239155371d5 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:03.679467 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e9f31c8-2436-47e0-8c6a-a239155371d5 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:03.680045 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e9f31c8-2436-47e0-8c6a-a239155371d5 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:03.680497 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e9f31c8-2436-47e0-8c6a-a239155371d5 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:03.681090 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e9f31c8-2436-47e0-8c6a-a239155371d5 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:03.783623 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0f1603b5-0a98-4d26-88e8-380697225a25 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:03.790197 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0f1603b5-0a98-4d26-88e8-380697225a25 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:03.790866 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f1603b5-0a98-4d26-88e8-380697225a25 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:03.791902 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f1603b5-0a98-4d26-88e8-380697225a25 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:03.792624 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f1603b5-0a98-4d26-88e8-380697225a25 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:03.793524 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f1603b5-0a98-4d26-88e8-380697225a25 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:03.794119 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f1603b5-0a98-4d26-88e8-380697225a25 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:03.794713 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0f1603b5-0a98-4d26-88e8-380697225a25 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:03.824930 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1e9f31c8-2436-47e0-8c6a-a239155371d5 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:03.834349 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1e9f31c8-2436-47e0-8c6a-a239155371d5 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.166975 Sep 06 04:36:03.859529 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 43/95] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:03 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:03.896918 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6825fc21-8898-4397-9892-e8ac37547060 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:03.910832 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6825fc21-8898-4397-9892-e8ac37547060 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:03.926462 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6825fc21-8898-4397-9892-e8ac37547060 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:03.927154 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6825fc21-8898-4397-9892-e8ac37547060 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:03.927740 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6825fc21-8898-4397-9892-e8ac37547060 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:03.928595 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6825fc21-8898-4397-9892-e8ac37547060 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:03.929395 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6825fc21-8898-4397-9892-e8ac37547060 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:03.929969 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6825fc21-8898-4397-9892-e8ac37547060 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:03.972977 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0f1603b5-0a98-4d26-88e8-380697225a25 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:03.972977 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0f1603b5-0a98-4d26-88e8-380697225a25 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.192754 Sep 06 04:36:03.981990 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 53/96] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:03 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:04.123528 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6825fc21-8898-4397-9892-e8ac37547060 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:04.131805 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6825fc21-8898-4397-9892-e8ac37547060 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.244033 Sep 06 04:36:04.132961 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 44/97] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:03 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:04.630382 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c1e2b765-d9fe-4a2c-9777-67fecf81e08a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:04.630979 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c1e2b765-d9fe-4a2c-9777-67fecf81e08a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:04.632826 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:36:04.637867 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1e2b765-d9fe-4a2c-9777-67fecf81e08a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:04.642315 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1e2b765-d9fe-4a2c-9777-67fecf81e08a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:04.642315 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1e2b765-d9fe-4a2c-9777-67fecf81e08a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:04.642315 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1e2b765-d9fe-4a2c-9777-67fecf81e08a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:04.642315 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1e2b765-d9fe-4a2c-9777-67fecf81e08a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:04.642650 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1e2b765-d9fe-4a2c-9777-67fecf81e08a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:04.823967 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c1e2b765-d9fe-4a2c-9777-67fecf81e08a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:04.833860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c1e2b765-d9fe-4a2c-9777-67fecf81e08a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:04.835761 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c1e2b765-d9fe-4a2c-9777-67fecf81e08a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:04.836955 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c1e2b765-d9fe-4a2c-9777-67fecf81e08a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.210404 Sep 06 04:36:04.837703 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 54/98] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:36:04 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:36:04.861994 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c48ca67b-3b35-4437-8826-7675781c07e9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:04.862877 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c48ca67b-3b35-4437-8826-7675781c07e9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:04.870282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c48ca67b-3b35-4437-8826-7675781c07e9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:04.871327 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c48ca67b-3b35-4437-8826-7675781c07e9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:04.871792 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c48ca67b-3b35-4437-8826-7675781c07e9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:04.872609 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c48ca67b-3b35-4437-8826-7675781c07e9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:04.873225 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c48ca67b-3b35-4437-8826-7675781c07e9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:04.875935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c48ca67b-3b35-4437-8826-7675781c07e9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:04.997962 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d642e185-5c8f-4426-bd0b-e21452b8d4f9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:05.005433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d642e185-5c8f-4426-bd0b-e21452b8d4f9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:05.014124 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d642e185-5c8f-4426-bd0b-e21452b8d4f9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:05.018736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d642e185-5c8f-4426-bd0b-e21452b8d4f9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:05.019379 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d642e185-5c8f-4426-bd0b-e21452b8d4f9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:05.020256 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d642e185-5c8f-4426-bd0b-e21452b8d4f9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:05.021332 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d642e185-5c8f-4426-bd0b-e21452b8d4f9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:05.021914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d642e185-5c8f-4426-bd0b-e21452b8d4f9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:05.045271 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c48ca67b-3b35-4437-8826-7675781c07e9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:05.053739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c48ca67b-3b35-4437-8826-7675781c07e9 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.195467 Sep 06 04:36:05.054841 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 45/99] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:04 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:05.158103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a0a9a56c-1c3b-473a-9131-fe5afbd44422 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:05.159118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a0a9a56c-1c3b-473a-9131-fe5afbd44422 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:05.165425 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0a9a56c-1c3b-473a-9131-fe5afbd44422 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:05.166151 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0a9a56c-1c3b-473a-9131-fe5afbd44422 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:05.167229 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0a9a56c-1c3b-473a-9131-fe5afbd44422 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:05.168097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0a9a56c-1c3b-473a-9131-fe5afbd44422 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:05.168600 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0a9a56c-1c3b-473a-9131-fe5afbd44422 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:05.169115 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0a9a56c-1c3b-473a-9131-fe5afbd44422 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:05.241855 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d642e185-5c8f-4426-bd0b-e21452b8d4f9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:05.251651 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d642e185-5c8f-4426-bd0b-e21452b8d4f9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.258898 Sep 06 04:36:05.263473 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 55/100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:04 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:05.319039 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a0a9a56c-1c3b-473a-9131-fe5afbd44422 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:05.327096 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a0a9a56c-1c3b-473a-9131-fe5afbd44422 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.175203 Sep 06 04:36:05.327666 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 46/101] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:05 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:05.869009 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bfb0d70e-a85d-424c-adc8-599a411c480c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:05.869673 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bfb0d70e-a85d-424c-adc8-599a411c480c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:05.876355 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfb0d70e-a85d-424c-adc8-599a411c480c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:05.876834 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfb0d70e-a85d-424c-adc8-599a411c480c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:05.877260 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfb0d70e-a85d-424c-adc8-599a411c480c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:05.877974 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfb0d70e-a85d-424c-adc8-599a411c480c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:05.878525 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfb0d70e-a85d-424c-adc8-599a411c480c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:05.878987 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bfb0d70e-a85d-424c-adc8-599a411c480c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:06.014405 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bfb0d70e-a85d-424c-adc8-599a411c480c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:06.027176 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bfb0d70e-a85d-424c-adc8-599a411c480c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:06.027176 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bfb0d70e-a85d-424c-adc8-599a411c480c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:06.027176 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bfb0d70e-a85d-424c-adc8-599a411c480c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.161274 Sep 06 04:36:06.027546 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 56/102] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:36:05 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:36:06.078010 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cd7f60f0-3681-4624-9a77-1eb2ccb3c5e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:06.078811 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cd7f60f0-3681-4624-9a77-1eb2ccb3c5e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:06.087002 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd7f60f0-3681-4624-9a77-1eb2ccb3c5e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:06.087569 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd7f60f0-3681-4624-9a77-1eb2ccb3c5e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:06.088610 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd7f60f0-3681-4624-9a77-1eb2ccb3c5e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:06.089587 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd7f60f0-3681-4624-9a77-1eb2ccb3c5e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:06.090104 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd7f60f0-3681-4624-9a77-1eb2ccb3c5e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:06.090713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd7f60f0-3681-4624-9a77-1eb2ccb3c5e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:06.094888 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:36:06.277235 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7fdb5522-cd9e-48f0-9663-6a5a6371b201 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:06.277879 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7fdb5522-cd9e-48f0-9663-6a5a6371b201 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:06.281094 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cd7f60f0-3681-4624-9a77-1eb2ccb3c5e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:06.293671 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cd7f60f0-3681-4624-9a77-1eb2ccb3c5e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.219326 Sep 06 04:36:06.304655 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 47/103] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:06 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:06.305791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fdb5522-cd9e-48f0-9663-6a5a6371b201 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:06.306384 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fdb5522-cd9e-48f0-9663-6a5a6371b201 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:06.306911 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fdb5522-cd9e-48f0-9663-6a5a6371b201 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:06.307830 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fdb5522-cd9e-48f0-9663-6a5a6371b201 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:06.308377 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fdb5522-cd9e-48f0-9663-6a5a6371b201 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:06.308954 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7fdb5522-cd9e-48f0-9663-6a5a6371b201 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:06.360565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e9df0f1c-4186-4860-a650-78d264785d8c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:06.375189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e9df0f1c-4186-4860-a650-78d264785d8c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:06.397369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9df0f1c-4186-4860-a650-78d264785d8c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:06.398225 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9df0f1c-4186-4860-a650-78d264785d8c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:06.398946 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9df0f1c-4186-4860-a650-78d264785d8c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:06.401116 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9df0f1c-4186-4860-a650-78d264785d8c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:06.401795 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9df0f1c-4186-4860-a650-78d264785d8c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:06.402229 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e9df0f1c-4186-4860-a650-78d264785d8c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:06.560595 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7fdb5522-cd9e-48f0-9663-6a5a6371b201 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:06.569975 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e9df0f1c-4186-4860-a650-78d264785d8c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:06.574454 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7fdb5522-cd9e-48f0-9663-6a5a6371b201 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.301584 Sep 06 04:36:06.576206 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 57/104] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:06 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:06.592818 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e9df0f1c-4186-4860-a650-78d264785d8c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.235944 Sep 06 04:36:06.594654 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 48/105] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:06 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:06.779800 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-92a03569-d9c6-44be-99b8-3b346974a4d7 req-20e20579-31a8-4bcb-a1e9-842bee79947d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed927594-12ef-48af-b170-5b88f8ecb0ec", "name": "network-vif-plugged", "status": "completed", "tag": "831811de-3ef7-415e-be56-fafeee2815c2"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:36:06.789341 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-92a03569-d9c6-44be-99b8-3b346974a4d7 req-20e20579-31a8-4bcb-a1e9-842bee79947d service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:06.789901 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-92a03569-d9c6-44be-99b8-3b346974a4d7 req-20e20579-31a8-4bcb-a1e9-842bee79947d service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:06.790397 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-92a03569-d9c6-44be-99b8-3b346974a4d7 req-20e20579-31a8-4bcb-a1e9-842bee79947d service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:06.802900 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-92a03569-d9c6-44be-99b8-3b346974a4d7 req-20e20579-31a8-4bcb-a1e9-842bee79947d service nova] Creating event network-vif-plugged:831811de-3ef7-415e-be56-fafeee2815c2 for instance ed927594-12ef-48af-b170-5b88f8ecb0ec on hv-cinder-85600 Sep 06 04:36:06.808537 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-92a03569-d9c6-44be-99b8-3b346974a4d7 req-20e20579-31a8-4bcb-a1e9-842bee79947d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103531 Sep 06 04:36:06.809237 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 58/106] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:36:07.060589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fb4e523a-230c-466b-8b55-a7a3063cc7f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:07.064995 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fb4e523a-230c-466b-8b55-a7a3063cc7f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:07.074063 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb4e523a-230c-466b-8b55-a7a3063cc7f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:07.074748 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb4e523a-230c-466b-8b55-a7a3063cc7f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:07.075943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb4e523a-230c-466b-8b55-a7a3063cc7f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:07.076797 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb4e523a-230c-466b-8b55-a7a3063cc7f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:07.077444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb4e523a-230c-466b-8b55-a7a3063cc7f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:07.078076 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb4e523a-230c-466b-8b55-a7a3063cc7f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:07.305368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fb4e523a-230c-466b-8b55-a7a3063cc7f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:07.319540 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fb4e523a-230c-466b-8b55-a7a3063cc7f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:07.321299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fb4e523a-230c-466b-8b55-a7a3063cc7f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:07.333165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fb4e523a-230c-466b-8b55-a7a3063cc7f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.273145 Sep 06 04:36:07.333553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2eadb49e-7a10-4c03-9ad0-f99dc6ec7015 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:07.333553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2eadb49e-7a10-4c03-9ad0-f99dc6ec7015 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:07.334121 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 49/107] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:36:07 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:36:07.336299 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2eadb49e-7a10-4c03-9ad0-f99dc6ec7015 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:07.336787 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2eadb49e-7a10-4c03-9ad0-f99dc6ec7015 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:07.337462 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2eadb49e-7a10-4c03-9ad0-f99dc6ec7015 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:07.338618 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2eadb49e-7a10-4c03-9ad0-f99dc6ec7015 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:07.339701 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2eadb49e-7a10-4c03-9ad0-f99dc6ec7015 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:07.340279 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2eadb49e-7a10-4c03-9ad0-f99dc6ec7015 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:07.564442 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2eadb49e-7a10-4c03-9ad0-f99dc6ec7015 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:07.572745 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2eadb49e-7a10-4c03-9ad0-f99dc6ec7015 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.247951 Sep 06 04:36:07.574018 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 59/108] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:07 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:07.606872 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-322e0ef7-b8ff-4025-a3cd-b2261078da5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:07.607480 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-322e0ef7-b8ff-4025-a3cd-b2261078da5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:07.614062 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-322e0ef7-b8ff-4025-a3cd-b2261078da5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:07.614833 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-322e0ef7-b8ff-4025-a3cd-b2261078da5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:07.615432 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-322e0ef7-b8ff-4025-a3cd-b2261078da5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:07.616282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-322e0ef7-b8ff-4025-a3cd-b2261078da5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:07.616882 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-322e0ef7-b8ff-4025-a3cd-b2261078da5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:07.620069 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-322e0ef7-b8ff-4025-a3cd-b2261078da5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:07.623666 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-12b4f7e4-cfae-4b58-a1c0-c3b9b0686341 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:07.624671 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-12b4f7e4-cfae-4b58-a1c0-c3b9b0686341 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:07.634973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12b4f7e4-cfae-4b58-a1c0-c3b9b0686341 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:07.636226 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12b4f7e4-cfae-4b58-a1c0-c3b9b0686341 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:07.636961 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12b4f7e4-cfae-4b58-a1c0-c3b9b0686341 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:07.638023 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12b4f7e4-cfae-4b58-a1c0-c3b9b0686341 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:07.638521 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12b4f7e4-cfae-4b58-a1c0-c3b9b0686341 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:07.639109 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-12b4f7e4-cfae-4b58-a1c0-c3b9b0686341 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:07.768766 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-322e0ef7-b8ff-4025-a3cd-b2261078da5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:07.777500 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-322e0ef7-b8ff-4025-a3cd-b2261078da5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.178134 Sep 06 04:36:07.781261 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 50/109] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:07 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:07.788325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-12b4f7e4-cfae-4b58-a1c0-c3b9b0686341 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:07.804244 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-12b4f7e4-cfae-4b58-a1c0-c3b9b0686341 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.182103 Sep 06 04:36:07.804244 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 60/110] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:07 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:08.357346 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eefa9931-f715-4af8-8288-19147ededdc3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:08.361445 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-eefa9931-f715-4af8-8288-19147ededdc3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:08.365372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eefa9931-f715-4af8-8288-19147ededdc3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:08.366099 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eefa9931-f715-4af8-8288-19147ededdc3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:08.366673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eefa9931-f715-4af8-8288-19147ededdc3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:08.367515 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eefa9931-f715-4af8-8288-19147ededdc3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:08.368321 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eefa9931-f715-4af8-8288-19147ededdc3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:08.368893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eefa9931-f715-4af8-8288-19147ededdc3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:08.577564 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eefa9931-f715-4af8-8288-19147ededdc3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:08.587038 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eefa9931-f715-4af8-8288-19147ededdc3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:08.588558 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eefa9931-f715-4af8-8288-19147ededdc3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:08.590228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-eefa9931-f715-4af8-8288-19147ededdc3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.237293 Sep 06 04:36:08.593475 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 51/111] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:36:08 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:36:08.601512 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1f894217-40bf-4535-aef1-6b8d5abe36af tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:08.601512 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1f894217-40bf-4535-aef1-6b8d5abe36af tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:08.605439 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f894217-40bf-4535-aef1-6b8d5abe36af tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:08.606361 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f894217-40bf-4535-aef1-6b8d5abe36af tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:08.607108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f894217-40bf-4535-aef1-6b8d5abe36af tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:08.608019 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f894217-40bf-4535-aef1-6b8d5abe36af tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:08.608667 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f894217-40bf-4535-aef1-6b8d5abe36af tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:08.609235 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f894217-40bf-4535-aef1-6b8d5abe36af tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:08.791807 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1f894217-40bf-4535-aef1-6b8d5abe36af tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:08.800822 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f3b9f90a-431e-4fb4-a60e-52b6e6934b87 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:08.802333 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f3b9f90a-431e-4fb4-a60e-52b6e6934b87 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:08.803904 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1f894217-40bf-4535-aef1-6b8d5abe36af tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.210359 Sep 06 04:36:08.817734 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 61/112] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:08 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:08.818075 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3b9f90a-431e-4fb4-a60e-52b6e6934b87 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:08.818075 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3b9f90a-431e-4fb4-a60e-52b6e6934b87 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:08.818075 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3b9f90a-431e-4fb4-a60e-52b6e6934b87 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:08.818075 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3b9f90a-431e-4fb4-a60e-52b6e6934b87 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:08.818433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3b9f90a-431e-4fb4-a60e-52b6e6934b87 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:08.818433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3b9f90a-431e-4fb4-a60e-52b6e6934b87 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:08.825986 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fd301839-25c7-4335-9049-71396f564d93 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:08.826618 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fd301839-25c7-4335-9049-71396f564d93 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:08.835094 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd301839-25c7-4335-9049-71396f564d93 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:08.835779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd301839-25c7-4335-9049-71396f564d93 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:08.836222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd301839-25c7-4335-9049-71396f564d93 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:08.836922 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd301839-25c7-4335-9049-71396f564d93 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:08.840840 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd301839-25c7-4335-9049-71396f564d93 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:08.842853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd301839-25c7-4335-9049-71396f564d93 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:09.015268 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f3b9f90a-431e-4fb4-a60e-52b6e6934b87 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:09.027828 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f3b9f90a-431e-4fb4-a60e-52b6e6934b87 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.229934 Sep 06 04:36:09.029029 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 52/113] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:08 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:09.033935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-379cd87a-0e56-4518-8c27-58a755d4b59a req-6e888d88-127e-4b1a-9b49-d3bdda01e9ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e4b2e8-d999-4a8f-90f7-cb565ec5c716", "name": "network-vif-plugged", "status": "completed", "tag": "6f3d018c-b1db-426d-bceb-91b09c7660bd"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:36:09.047416 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-379cd87a-0e56-4518-8c27-58a755d4b59a req-6e888d88-127e-4b1a-9b49-d3bdda01e9ea service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:09.048264 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-379cd87a-0e56-4518-8c27-58a755d4b59a req-6e888d88-127e-4b1a-9b49-d3bdda01e9ea service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:09.048703 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-379cd87a-0e56-4518-8c27-58a755d4b59a req-6e888d88-127e-4b1a-9b49-d3bdda01e9ea service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:09.070374 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-379cd87a-0e56-4518-8c27-58a755d4b59a req-6e888d88-127e-4b1a-9b49-d3bdda01e9ea service nova] Creating event network-vif-plugged:6f3d018c-b1db-426d-bceb-91b09c7660bd for instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 on hv-cinder-85600 Sep 06 04:36:09.086317 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-379cd87a-0e56-4518-8c27-58a755d4b59a req-6e888d88-127e-4b1a-9b49-d3bdda01e9ea service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055739 Sep 06 04:36:09.087266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 53/114] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:36:09.302553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fd301839-25c7-4335-9049-71396f564d93 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:09.310418 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fd301839-25c7-4335-9049-71396f564d93 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.490909 Sep 06 04:36:09.311246 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 62/115] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:08 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:09.617663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-56cdbefe-b12c-4f6e-942a-7eace74fd855 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:09.618465 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-56cdbefe-b12c-4f6e-942a-7eace74fd855 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:09.625706 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-56cdbefe-b12c-4f6e-942a-7eace74fd855 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:09.626359 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-56cdbefe-b12c-4f6e-942a-7eace74fd855 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:09.626776 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-56cdbefe-b12c-4f6e-942a-7eace74fd855 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:09.627516 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-56cdbefe-b12c-4f6e-942a-7eace74fd855 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:09.627966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-56cdbefe-b12c-4f6e-942a-7eace74fd855 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:09.628380 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-56cdbefe-b12c-4f6e-942a-7eace74fd855 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:09.769754 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-56cdbefe-b12c-4f6e-942a-7eace74fd855 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:09.782085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-56cdbefe-b12c-4f6e-942a-7eace74fd855 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:09.782085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-56cdbefe-b12c-4f6e-942a-7eace74fd855 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:09.782085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-56cdbefe-b12c-4f6e-942a-7eace74fd855 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.168493 Sep 06 04:36:09.782888 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 54/116] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:36:09 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:36:09.832672 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8fc43790-edec-4e82-b58a-0ef220c38998 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:09.833858 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8fc43790-edec-4e82-b58a-0ef220c38998 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:09.841240 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8fc43790-edec-4e82-b58a-0ef220c38998 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:09.841750 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8fc43790-edec-4e82-b58a-0ef220c38998 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:09.842378 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8fc43790-edec-4e82-b58a-0ef220c38998 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:09.843073 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8fc43790-edec-4e82-b58a-0ef220c38998 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:09.843529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8fc43790-edec-4e82-b58a-0ef220c38998 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:09.844206 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8fc43790-edec-4e82-b58a-0ef220c38998 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:10.029225 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8fc43790-edec-4e82-b58a-0ef220c38998 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:10.037987 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8fc43790-edec-4e82-b58a-0ef220c38998 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.210039 Sep 06 04:36:10.041767 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 63/117] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:09 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:10.054741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2e0c2146-0a2e-4b36-a69b-fda8d3e266a2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:10.055581 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2e0c2146-0a2e-4b36-a69b-fda8d3e266a2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:10.065931 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e0c2146-0a2e-4b36-a69b-fda8d3e266a2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:10.070868 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e0c2146-0a2e-4b36-a69b-fda8d3e266a2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:10.070868 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e0c2146-0a2e-4b36-a69b-fda8d3e266a2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:10.070868 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e0c2146-0a2e-4b36-a69b-fda8d3e266a2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:10.070868 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e0c2146-0a2e-4b36-a69b-fda8d3e266a2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:10.071216 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e0c2146-0a2e-4b36-a69b-fda8d3e266a2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:10.342415 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c576f1d1-03fe-4bc2-a627-7d1f166004b1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:10.343122 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c576f1d1-03fe-4bc2-a627-7d1f166004b1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:10.358569 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c576f1d1-03fe-4bc2-a627-7d1f166004b1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:10.361112 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c576f1d1-03fe-4bc2-a627-7d1f166004b1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:10.361112 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c576f1d1-03fe-4bc2-a627-7d1f166004b1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:10.361112 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c576f1d1-03fe-4bc2-a627-7d1f166004b1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:10.365406 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c576f1d1-03fe-4bc2-a627-7d1f166004b1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:10.366276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c576f1d1-03fe-4bc2-a627-7d1f166004b1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:10.400668 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2e0c2146-0a2e-4b36-a69b-fda8d3e266a2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:10.415070 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2e0c2146-0a2e-4b36-a69b-fda8d3e266a2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.364277 Sep 06 04:36:10.420369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 55/118] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:10 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:10.614307 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c576f1d1-03fe-4bc2-a627-7d1f166004b1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:10.624132 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c576f1d1-03fe-4bc2-a627-7d1f166004b1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.293993 Sep 06 04:36:10.629484 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 64/119] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:10 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:10.807431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-16fe3860-6eb0-4f82-8552-c2782fb7e857 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:10.808639 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-16fe3860-6eb0-4f82-8552-c2782fb7e857 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:10.825097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16fe3860-6eb0-4f82-8552-c2782fb7e857 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:10.827989 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16fe3860-6eb0-4f82-8552-c2782fb7e857 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:10.827989 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16fe3860-6eb0-4f82-8552-c2782fb7e857 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:10.827989 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16fe3860-6eb0-4f82-8552-c2782fb7e857 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:10.827989 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16fe3860-6eb0-4f82-8552-c2782fb7e857 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:10.832569 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-16fe3860-6eb0-4f82-8552-c2782fb7e857 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:11.022454 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-16fe3860-6eb0-4f82-8552-c2782fb7e857 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:11.031400 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-16fe3860-6eb0-4f82-8552-c2782fb7e857 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:11.032884 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-16fe3860-6eb0-4f82-8552-c2782fb7e857 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:11.033922 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-16fe3860-6eb0-4f82-8552-c2782fb7e857 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.231132 Sep 06 04:36:11.034476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 56/120] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:36:10 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:36:11.064170 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-39389c34-e782-4f3a-abfd-bed01110e6b8 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:11.065478 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-39389c34-e782-4f3a-abfd-bed01110e6b8 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:11.071418 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39389c34-e782-4f3a-abfd-bed01110e6b8 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:11.071911 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39389c34-e782-4f3a-abfd-bed01110e6b8 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:11.072330 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39389c34-e782-4f3a-abfd-bed01110e6b8 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:11.073794 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39389c34-e782-4f3a-abfd-bed01110e6b8 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:11.074248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39389c34-e782-4f3a-abfd-bed01110e6b8 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:11.074665 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-39389c34-e782-4f3a-abfd-bed01110e6b8 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:11.099361 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:36:11.126324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-74a5c1ca-4bc0-489a-be5e-a324dece99dc req-b8b34e9a-466a-4a0b-bdfa-301299549e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7855d2a-a4a4-44fa-9200-c2b74b273458", "name": "network-vif-plugged", "status": "completed", "tag": "7dd08f26-fca9-44dc-9f2f-a94635106365"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:36:11.146905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-74a5c1ca-4bc0-489a-be5e-a324dece99dc req-b8b34e9a-466a-4a0b-bdfa-301299549e2b service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:11.147478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-74a5c1ca-4bc0-489a-be5e-a324dece99dc req-b8b34e9a-466a-4a0b-bdfa-301299549e2b service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:11.148307 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-74a5c1ca-4bc0-489a-be5e-a324dece99dc req-b8b34e9a-466a-4a0b-bdfa-301299549e2b service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:11.165393 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-74a5c1ca-4bc0-489a-be5e-a324dece99dc req-b8b34e9a-466a-4a0b-bdfa-301299549e2b service nova] Creating event network-vif-plugged:7dd08f26-fca9-44dc-9f2f-a94635106365 for instance c7855d2a-a4a4-44fa-9200-c2b74b273458 on hv-cinder-85600 Sep 06 04:36:11.173206 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-74a5c1ca-4bc0-489a-be5e-a324dece99dc req-b8b34e9a-466a-4a0b-bdfa-301299549e2b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050788 Sep 06 04:36:11.176369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 57/121] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:36:11.234871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-39389c34-e782-4f3a-abfd-bed01110e6b8 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:11.243396 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-39389c34-e782-4f3a-abfd-bed01110e6b8 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.183236 Sep 06 04:36:11.244072 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 65/122] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:11 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:11.444871 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4777a3ad-6b43-4ed0-a880-530262a8771d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:11.445777 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4777a3ad-6b43-4ed0-a880-530262a8771d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:11.453732 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4777a3ad-6b43-4ed0-a880-530262a8771d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:11.454226 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4777a3ad-6b43-4ed0-a880-530262a8771d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:11.454825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4777a3ad-6b43-4ed0-a880-530262a8771d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:11.455804 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4777a3ad-6b43-4ed0-a880-530262a8771d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:11.456257 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4777a3ad-6b43-4ed0-a880-530262a8771d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:11.456678 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4777a3ad-6b43-4ed0-a880-530262a8771d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:11.656068 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e37037e4-7cfd-49a5-a08f-93d0aa381ce0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:11.657368 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e37037e4-7cfd-49a5-a08f-93d0aa381ce0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:11.669730 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e37037e4-7cfd-49a5-a08f-93d0aa381ce0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:11.670586 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e37037e4-7cfd-49a5-a08f-93d0aa381ce0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:11.671029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e37037e4-7cfd-49a5-a08f-93d0aa381ce0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:11.671757 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e37037e4-7cfd-49a5-a08f-93d0aa381ce0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:11.672198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e37037e4-7cfd-49a5-a08f-93d0aa381ce0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:11.672620 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e37037e4-7cfd-49a5-a08f-93d0aa381ce0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:11.696025 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4777a3ad-6b43-4ed0-a880-530262a8771d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:11.716058 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4777a3ad-6b43-4ed0-a880-530262a8771d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.275524 Sep 06 04:36:11.716858 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 58/123] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:11 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:11.873549 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e37037e4-7cfd-49a5-a08f-93d0aa381ce0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:11.880962 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e37037e4-7cfd-49a5-a08f-93d0aa381ce0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.231353 Sep 06 04:36:11.881928 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 66/124] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:11 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:12.061456 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d31a940d-bc0a-4380-96e8-f52416ac0e64 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:12.062063 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d31a940d-bc0a-4380-96e8-f52416ac0e64 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:12.068094 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d31a940d-bc0a-4380-96e8-f52416ac0e64 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:12.068721 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d31a940d-bc0a-4380-96e8-f52416ac0e64 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:12.069140 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d31a940d-bc0a-4380-96e8-f52416ac0e64 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:12.069914 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d31a940d-bc0a-4380-96e8-f52416ac0e64 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:12.070306 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d31a940d-bc0a-4380-96e8-f52416ac0e64 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:12.070729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d31a940d-bc0a-4380-96e8-f52416ac0e64 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:12.207971 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d31a940d-bc0a-4380-96e8-f52416ac0e64 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:12.214680 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d31a940d-bc0a-4380-96e8-f52416ac0e64 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:12.216108 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d31a940d-bc0a-4380-96e8-f52416ac0e64 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:12.217565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d31a940d-bc0a-4380-96e8-f52416ac0e64 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.160514 Sep 06 04:36:12.218123 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 59/125] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:36:12 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:36:12.268043 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9b5c5b2c-4e9d-438c-a8e3-3b3dcded19b0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:12.285591 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9b5c5b2c-4e9d-438c-a8e3-3b3dcded19b0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:12.285591 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b5c5b2c-4e9d-438c-a8e3-3b3dcded19b0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:12.285591 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b5c5b2c-4e9d-438c-a8e3-3b3dcded19b0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:12.285591 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b5c5b2c-4e9d-438c-a8e3-3b3dcded19b0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:12.285940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b5c5b2c-4e9d-438c-a8e3-3b3dcded19b0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:12.285940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b5c5b2c-4e9d-438c-a8e3-3b3dcded19b0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:12.285940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b5c5b2c-4e9d-438c-a8e3-3b3dcded19b0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:12.453011 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9b5c5b2c-4e9d-438c-a8e3-3b3dcded19b0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:12.464563 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9b5c5b2c-4e9d-438c-a8e3-3b3dcded19b0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1315 microversion: 2.1 time: 0.200130 Sep 06 04:36:12.465523 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 67/126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:12 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:12.743051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d9a344df-fcc4-401a-92f2-db9923da22d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:12.743650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d9a344df-fcc4-401a-92f2-db9923da22d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:12.749962 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9a344df-fcc4-401a-92f2-db9923da22d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:12.750429 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9a344df-fcc4-401a-92f2-db9923da22d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:12.751606 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9a344df-fcc4-401a-92f2-db9923da22d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:12.752447 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9a344df-fcc4-401a-92f2-db9923da22d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:12.754616 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9a344df-fcc4-401a-92f2-db9923da22d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:12.754616 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d9a344df-fcc4-401a-92f2-db9923da22d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:12.907341 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6105813d-9ffb-4931-bf70-0ea251f97a9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:12.908370 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6105813d-9ffb-4931-bf70-0ea251f97a9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:12.919032 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6105813d-9ffb-4931-bf70-0ea251f97a9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:12.919850 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6105813d-9ffb-4931-bf70-0ea251f97a9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:12.920477 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6105813d-9ffb-4931-bf70-0ea251f97a9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:12.921481 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6105813d-9ffb-4931-bf70-0ea251f97a9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:12.922660 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6105813d-9ffb-4931-bf70-0ea251f97a9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:12.923484 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6105813d-9ffb-4931-bf70-0ea251f97a9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:12.948971 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d9a344df-fcc4-401a-92f2-db9923da22d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:12.957947 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d9a344df-fcc4-401a-92f2-db9923da22d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.218727 Sep 06 04:36:12.961355 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 60/127] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:12 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:13.180914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6105813d-9ffb-4931-bf70-0ea251f97a9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:13.189241 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6105813d-9ffb-4931-bf70-0ea251f97a9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.286162 Sep 06 04:36:13.205506 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 68/128] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:12 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:13.227956 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-51fdcf07-bb47-4a0f-aad4-ad74c359e800 req-7685e380-e15b-416b-8df0-2d40c4bc4545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53238a8f-2601-4952-acd2-4dcb02761c12", "name": "network-vif-plugged", "status": "completed", "tag": "19322183-60e8-44ac-b690-7448dfce3250"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:36:13.244028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-61076b04-75a0-4806-bbfb-f3d933cdbf9a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:13.245355 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-61076b04-75a0-4806-bbfb-f3d933cdbf9a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:13.245934 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-51fdcf07-bb47-4a0f-aad4-ad74c359e800 req-7685e380-e15b-416b-8df0-2d40c4bc4545 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:13.247148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-51fdcf07-bb47-4a0f-aad4-ad74c359e800 req-7685e380-e15b-416b-8df0-2d40c4bc4545 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:13.247729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-51fdcf07-bb47-4a0f-aad4-ad74c359e800 req-7685e380-e15b-416b-8df0-2d40c4bc4545 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:13.253048 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61076b04-75a0-4806-bbfb-f3d933cdbf9a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:13.259120 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61076b04-75a0-4806-bbfb-f3d933cdbf9a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:13.259120 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61076b04-75a0-4806-bbfb-f3d933cdbf9a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:13.259120 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61076b04-75a0-4806-bbfb-f3d933cdbf9a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:13.259120 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61076b04-75a0-4806-bbfb-f3d933cdbf9a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:13.259557 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61076b04-75a0-4806-bbfb-f3d933cdbf9a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:13.262582 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-51fdcf07-bb47-4a0f-aad4-ad74c359e800 req-7685e380-e15b-416b-8df0-2d40c4bc4545 service nova] Creating event network-vif-plugged:19322183-60e8-44ac-b690-7448dfce3250 for instance 53238a8f-2601-4952-acd2-4dcb02761c12 on hv-cinder-85600 Sep 06 04:36:13.278071 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-51fdcf07-bb47-4a0f-aad4-ad74c359e800 req-7685e380-e15b-416b-8df0-2d40c4bc4545 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049422 Sep 06 04:36:13.290713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 61/129] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:36:13.495467 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9e3bcb60-ed4a-4313-8013-adb2595af8e0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:13.496405 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9e3bcb60-ed4a-4313-8013-adb2595af8e0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:13.512378 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e3bcb60-ed4a-4313-8013-adb2595af8e0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:13.512973 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e3bcb60-ed4a-4313-8013-adb2595af8e0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:13.513552 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e3bcb60-ed4a-4313-8013-adb2595af8e0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:13.514270 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e3bcb60-ed4a-4313-8013-adb2595af8e0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:13.514779 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e3bcb60-ed4a-4313-8013-adb2595af8e0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:13.515198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e3bcb60-ed4a-4313-8013-adb2595af8e0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:13.546145 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-61076b04-75a0-4806-bbfb-f3d933cdbf9a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:13.555678 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-61076b04-75a0-4806-bbfb-f3d933cdbf9a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:13.558378 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-61076b04-75a0-4806-bbfb-f3d933cdbf9a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:13.560095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-61076b04-75a0-4806-bbfb-f3d933cdbf9a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.320150 Sep 06 04:36:13.561131 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 69/130] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:36:13 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:36:13.672330 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9e3bcb60-ed4a-4313-8013-adb2595af8e0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:13.680081 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9e3bcb60-ed4a-4313-8013-adb2595af8e0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1502 microversion: 2.1 time: 0.193460 Sep 06 04:36:13.680650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 62/131] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:13 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:13.982885 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6494da67-57c1-4119-8314-7e36fe4329cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:13.983493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6494da67-57c1-4119-8314-7e36fe4329cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:13.989243 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6494da67-57c1-4119-8314-7e36fe4329cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:13.989742 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6494da67-57c1-4119-8314-7e36fe4329cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:13.990170 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6494da67-57c1-4119-8314-7e36fe4329cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:13.990833 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6494da67-57c1-4119-8314-7e36fe4329cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:13.991294 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6494da67-57c1-4119-8314-7e36fe4329cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:13.991727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6494da67-57c1-4119-8314-7e36fe4329cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:14.126900 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6494da67-57c1-4119-8314-7e36fe4329cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:14.134454 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6494da67-57c1-4119-8314-7e36fe4329cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.155926 Sep 06 04:36:14.135585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 70/132] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:13 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:14.212657 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-00a93919-58d0-494d-bc77-ec3379be525d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:14.214367 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-00a93919-58d0-494d-bc77-ec3379be525d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:14.221511 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00a93919-58d0-494d-bc77-ec3379be525d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:14.222344 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00a93919-58d0-494d-bc77-ec3379be525d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:14.223119 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00a93919-58d0-494d-bc77-ec3379be525d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:14.223962 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00a93919-58d0-494d-bc77-ec3379be525d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:14.224563 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00a93919-58d0-494d-bc77-ec3379be525d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:14.225130 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00a93919-58d0-494d-bc77-ec3379be525d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:14.424056 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-00a93919-58d0-494d-bc77-ec3379be525d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:14.444253 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-00a93919-58d0-494d-bc77-ec3379be525d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.235784 Sep 06 04:36:14.444979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 63/133] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:14 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:14.586167 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fcea5719-7e38-4a99-9dae-6088f03068d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:14.587842 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fcea5719-7e38-4a99-9dae-6088f03068d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:14.598606 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcea5719-7e38-4a99-9dae-6088f03068d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:14.599350 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcea5719-7e38-4a99-9dae-6088f03068d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:14.600099 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcea5719-7e38-4a99-9dae-6088f03068d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:14.605679 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcea5719-7e38-4a99-9dae-6088f03068d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:14.606421 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcea5719-7e38-4a99-9dae-6088f03068d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:14.607084 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fcea5719-7e38-4a99-9dae-6088f03068d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:14.901081 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fcea5719-7e38-4a99-9dae-6088f03068d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:14.910298 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fcea5719-7e38-4a99-9dae-6088f03068d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:14.912167 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fcea5719-7e38-4a99-9dae-6088f03068d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:14.913495 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fcea5719-7e38-4a99-9dae-6088f03068d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.331868 Sep 06 04:36:14.914654 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 71/134] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:36:14 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:36:15.164229 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0b3dd421-729b-46d3-b7a3-537f99c25fbe tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:15.164229 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0b3dd421-729b-46d3-b7a3-537f99c25fbe tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:15.169856 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b3dd421-729b-46d3-b7a3-537f99c25fbe tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:15.170339 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b3dd421-729b-46d3-b7a3-537f99c25fbe tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:15.170774 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b3dd421-729b-46d3-b7a3-537f99c25fbe tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:15.171503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b3dd421-729b-46d3-b7a3-537f99c25fbe tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:15.171894 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b3dd421-729b-46d3-b7a3-537f99c25fbe tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:15.172308 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b3dd421-729b-46d3-b7a3-537f99c25fbe tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:15.329966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0b3dd421-729b-46d3-b7a3-537f99c25fbe tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:15.337669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0b3dd421-729b-46d3-b7a3-537f99c25fbe tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1322 microversion: 2.1 time: 0.179134 Sep 06 04:36:15.342958 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 64/135] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:15 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:15.344652 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-0ef89475-a172-4df8-893b-4c3224b03fc3 req-9a363058-646c-4e77-b0a5-27b6c97ccb1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "655e54ca-b46d-40ea-a544-c796990772d7", "name": "network-vif-plugged", "status": "completed", "tag": "f88cebc5-b6a7-4ea8-9133-58a12f404543"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:36:15.365570 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-0ef89475-a172-4df8-893b-4c3224b03fc3 req-9a363058-646c-4e77-b0a5-27b6c97ccb1d service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:15.365570 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-0ef89475-a172-4df8-893b-4c3224b03fc3 req-9a363058-646c-4e77-b0a5-27b6c97ccb1d service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:15.365570 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-0ef89475-a172-4df8-893b-4c3224b03fc3 req-9a363058-646c-4e77-b0a5-27b6c97ccb1d service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:15.379666 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-0ef89475-a172-4df8-893b-4c3224b03fc3 req-9a363058-646c-4e77-b0a5-27b6c97ccb1d service nova] Creating event network-vif-plugged:f88cebc5-b6a7-4ea8-9133-58a12f404543 for instance 655e54ca-b46d-40ea-a544-c796990772d7 on hv-cinder-85600 Sep 06 04:36:15.387790 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-0ef89475-a172-4df8-893b-4c3224b03fc3 req-9a363058-646c-4e77-b0a5-27b6c97ccb1d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051897 Sep 06 04:36:15.389464 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 72/136] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:36:15.480395 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d2b020e0-d16c-4f25-9158-4d4d50d09cfb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:15.481739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d2b020e0-d16c-4f25-9158-4d4d50d09cfb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:15.489572 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2b020e0-d16c-4f25-9158-4d4d50d09cfb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:15.490388 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2b020e0-d16c-4f25-9158-4d4d50d09cfb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:15.491218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2b020e0-d16c-4f25-9158-4d4d50d09cfb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:15.497137 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2b020e0-d16c-4f25-9158-4d4d50d09cfb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:15.497865 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2b020e0-d16c-4f25-9158-4d4d50d09cfb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:15.499911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2b020e0-d16c-4f25-9158-4d4d50d09cfb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:15.650138 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d2b020e0-d16c-4f25-9158-4d4d50d09cfb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:15.659387 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:36:15.661126 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d2b020e0-d16c-4f25-9158-4d4d50d09cfb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.189332 Sep 06 04:36:15.663680 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 65/137] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:15 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:15.942087 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-94c4cd14-4cd2-4958-92b3-4171a18ed564 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:15.942826 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-94c4cd14-4cd2-4958-92b3-4171a18ed564 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:15.949972 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-94c4cd14-4cd2-4958-92b3-4171a18ed564 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:15.950475 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-94c4cd14-4cd2-4958-92b3-4171a18ed564 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:15.951136 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-94c4cd14-4cd2-4958-92b3-4171a18ed564 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:15.951884 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-94c4cd14-4cd2-4958-92b3-4171a18ed564 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:15.952410 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-94c4cd14-4cd2-4958-92b3-4171a18ed564 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:15.952917 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-94c4cd14-4cd2-4958-92b3-4171a18ed564 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:16.104453 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-94c4cd14-4cd2-4958-92b3-4171a18ed564 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:16.115416 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-94c4cd14-4cd2-4958-92b3-4171a18ed564 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:16.117891 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-94c4cd14-4cd2-4958-92b3-4171a18ed564 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:16.120274 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-94c4cd14-4cd2-4958-92b3-4171a18ed564 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.181720 Sep 06 04:36:16.122527 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 73/138] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:36:15 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:36:16.364773 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4ca6aff5-3e0c-4b35-a37d-c099cfcc4d60 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:16.365720 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4ca6aff5-3e0c-4b35-a37d-c099cfcc4d60 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:16.374315 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ca6aff5-3e0c-4b35-a37d-c099cfcc4d60 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:16.379477 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ca6aff5-3e0c-4b35-a37d-c099cfcc4d60 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:16.379477 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ca6aff5-3e0c-4b35-a37d-c099cfcc4d60 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:16.379477 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ca6aff5-3e0c-4b35-a37d-c099cfcc4d60 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:16.379477 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ca6aff5-3e0c-4b35-a37d-c099cfcc4d60 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:16.379864 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ca6aff5-3e0c-4b35-a37d-c099cfcc4d60 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:16.514739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4ca6aff5-3e0c-4b35-a37d-c099cfcc4d60 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:16.529008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4ca6aff5-3e0c-4b35-a37d-c099cfcc4d60 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1515 microversion: 2.1 time: 0.167886 Sep 06 04:36:16.541329 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 66/139] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:16 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:16.554875 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-741cfe86-a150-403e-a39c-feae17215ce2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:36:16.557751 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-741cfe86-a150-403e-a39c-feae17215ce2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:16.568103 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-741cfe86-a150-403e-a39c-feae17215ce2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:16.568854 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-741cfe86-a150-403e-a39c-feae17215ce2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:16.569566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-741cfe86-a150-403e-a39c-feae17215ce2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:16.570461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-741cfe86-a150-403e-a39c-feae17215ce2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:16.570930 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-741cfe86-a150-403e-a39c-feae17215ce2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:16.571343 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-741cfe86-a150-403e-a39c-feae17215ce2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:16.652129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dec31267-11db-491c-afdd-a4fa4fa8a3dd tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d47a935-8b57-41bb-b397-0e3b694bcd0c"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:36:16.653125 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-741cfe86-a150-403e-a39c-feae17215ce2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lazy-loading 'flavor' on Instance uuid c7855d2a-a4a4-44fa-9200-c2b74b273458 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:36:16.655032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dec31267-11db-491c-afdd-a4fa4fa8a3dd tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:16.661481 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dec31267-11db-491c-afdd-a4fa4fa8a3dd tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:16.661964 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dec31267-11db-491c-afdd-a4fa4fa8a3dd tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:16.662408 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dec31267-11db-491c-afdd-a4fa4fa8a3dd tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:16.663077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dec31267-11db-491c-afdd-a4fa4fa8a3dd tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:16.663525 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dec31267-11db-491c-afdd-a4fa4fa8a3dd tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:16.663941 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dec31267-11db-491c-afdd-a4fa4fa8a3dd tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:16.989769 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-741cfe86-a150-403e-a39c-feae17215ce2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "POST /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458/action" status: 200 len: 32 microversion: 2.1 time: 0.439426 Sep 06 04:36:16.993383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 74/140] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Sep 6 04:36:16 2022] POST /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458/action => generated 32 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 04:36:17.000520 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-24a8f1ee-6348-4243-bfd2-c7705495859e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:17.001419 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-24a8f1ee-6348-4243-bfd2-c7705495859e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:17.008425 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24a8f1ee-6348-4243-bfd2-c7705495859e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:17.008790 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24a8f1ee-6348-4243-bfd2-c7705495859e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:17.009413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24a8f1ee-6348-4243-bfd2-c7705495859e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:17.010141 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24a8f1ee-6348-4243-bfd2-c7705495859e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:17.010754 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24a8f1ee-6348-4243-bfd2-c7705495859e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:17.011158 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24a8f1ee-6348-4243-bfd2-c7705495859e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:17.163482 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-24a8f1ee-6348-4243-bfd2-c7705495859e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:17.172176 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-24a8f1ee-6348-4243-bfd2-c7705495859e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.179318 Sep 06 04:36:17.172761 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 75/141] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:16 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:17.177925 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2bf116d5-f2fb-4dec-88fe-c3b6dba930ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:17.178780 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2bf116d5-f2fb-4dec-88fe-c3b6dba930ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:17.185651 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bf116d5-f2fb-4dec-88fe-c3b6dba930ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:17.186391 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bf116d5-f2fb-4dec-88fe-c3b6dba930ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:17.186997 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bf116d5-f2fb-4dec-88fe-c3b6dba930ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:17.188005 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bf116d5-f2fb-4dec-88fe-c3b6dba930ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:17.188622 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bf116d5-f2fb-4dec-88fe-c3b6dba930ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:17.189221 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bf116d5-f2fb-4dec-88fe-c3b6dba930ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:17.372471 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2bf116d5-f2fb-4dec-88fe-c3b6dba930ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:17.382334 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2bf116d5-f2fb-4dec-88fe-c3b6dba930ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.208025 Sep 06 04:36:17.382713 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 76/142] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:17 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:17.400153 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b3cc7708-dbc1-4351-ad78-77a11e0c064e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:17.400153 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b3cc7708-dbc1-4351-ad78-77a11e0c064e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:17.409679 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b3cc7708-dbc1-4351-ad78-77a11e0c064e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:17.410547 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b3cc7708-dbc1-4351-ad78-77a11e0c064e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:17.412151 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b3cc7708-dbc1-4351-ad78-77a11e0c064e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:17.413254 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b3cc7708-dbc1-4351-ad78-77a11e0c064e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:17.413980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b3cc7708-dbc1-4351-ad78-77a11e0c064e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:17.414878 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b3cc7708-dbc1-4351-ad78-77a11e0c064e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:17.567522 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b3cc7708-dbc1-4351-ad78-77a11e0c064e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:17.576121 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b3cc7708-dbc1-4351-ad78-77a11e0c064e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:17.577621 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b3cc7708-dbc1-4351-ad78-77a11e0c064e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:17.578727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b3cc7708-dbc1-4351-ad78-77a11e0c064e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1406 microversion: 2.20 time: 0.190706 Sep 06 04:36:17.579271 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 77/143] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:36:17 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:36:18.198875 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-71766c6c-ae65-4957-a58e-f494528f6307 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:18.199759 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-71766c6c-ae65-4957-a58e-f494528f6307 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:18.210945 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71766c6c-ae65-4957-a58e-f494528f6307 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:18.211432 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71766c6c-ae65-4957-a58e-f494528f6307 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:18.212190 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71766c6c-ae65-4957-a58e-f494528f6307 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:18.214564 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71766c6c-ae65-4957-a58e-f494528f6307 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:18.215517 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71766c6c-ae65-4957-a58e-f494528f6307 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:18.216757 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71766c6c-ae65-4957-a58e-f494528f6307 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:18.365123 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-71766c6c-ae65-4957-a58e-f494528f6307 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:18.376409 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-71766c6c-ae65-4957-a58e-f494528f6307 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.183738 Sep 06 04:36:18.377021 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 78/144] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:18 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:18.406668 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-62fcd01f-cef6-4f86-a084-511d793566c9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:18.407364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-62fcd01f-cef6-4f86-a084-511d793566c9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:18.410459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:36:18.413874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62fcd01f-cef6-4f86-a084-511d793566c9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:18.414424 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62fcd01f-cef6-4f86-a084-511d793566c9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:18.414943 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62fcd01f-cef6-4f86-a084-511d793566c9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:18.415629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62fcd01f-cef6-4f86-a084-511d793566c9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:18.416078 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62fcd01f-cef6-4f86-a084-511d793566c9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:18.416494 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62fcd01f-cef6-4f86-a084-511d793566c9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:18.556945 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-62fcd01f-cef6-4f86-a084-511d793566c9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:18.565418 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-62fcd01f-cef6-4f86-a084-511d793566c9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.163417 Sep 06 04:36:18.565969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 79/145] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:18 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:18.604610 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f59f4a8e-8f60-4abd-9d1b-8ea3f8e56a7f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:18.605807 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f59f4a8e-8f60-4abd-9d1b-8ea3f8e56a7f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:18.611502 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f59f4a8e-8f60-4abd-9d1b-8ea3f8e56a7f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:18.611982 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f59f4a8e-8f60-4abd-9d1b-8ea3f8e56a7f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:18.612416 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f59f4a8e-8f60-4abd-9d1b-8ea3f8e56a7f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:18.613097 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f59f4a8e-8f60-4abd-9d1b-8ea3f8e56a7f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:18.613594 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f59f4a8e-8f60-4abd-9d1b-8ea3f8e56a7f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:18.613992 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f59f4a8e-8f60-4abd-9d1b-8ea3f8e56a7f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:18.748124 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f59f4a8e-8f60-4abd-9d1b-8ea3f8e56a7f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:18.751526 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:36:18.756335 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f59f4a8e-8f60-4abd-9d1b-8ea3f8e56a7f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:18.757792 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f59f4a8e-8f60-4abd-9d1b-8ea3f8e56a7f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:18.758958 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f59f4a8e-8f60-4abd-9d1b-8ea3f8e56a7f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1598 microversion: 2.20 time: 0.158080 Sep 06 04:36:18.759517 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 80/146] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:36:18 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1598 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:36:18.783593 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3b262866-267a-4ce6-863e-e367dc252808 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:18.784079 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3b262866-267a-4ce6-863e-e367dc252808 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:18.789832 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b262866-267a-4ce6-863e-e367dc252808 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:18.790310 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b262866-267a-4ce6-863e-e367dc252808 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:18.790737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b262866-267a-4ce6-863e-e367dc252808 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:18.791409 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b262866-267a-4ce6-863e-e367dc252808 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:18.791856 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b262866-267a-4ce6-863e-e367dc252808 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:18.792273 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b262866-267a-4ce6-863e-e367dc252808 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:18.871596 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3b262866-267a-4ce6-863e-e367dc252808 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091611 Sep 06 04:36:18.872397 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 81/147] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Sep 6 04:36:18 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 04:36:19.399678 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9ea6f908-5117-4f8c-958b-d986cc023903 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:19.400497 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9ea6f908-5117-4f8c-958b-d986cc023903 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:19.407675 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ea6f908-5117-4f8c-958b-d986cc023903 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:19.408157 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ea6f908-5117-4f8c-958b-d986cc023903 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:19.408590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ea6f908-5117-4f8c-958b-d986cc023903 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:19.409278 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ea6f908-5117-4f8c-958b-d986cc023903 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:19.414331 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ea6f908-5117-4f8c-958b-d986cc023903 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:19.414331 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ea6f908-5117-4f8c-958b-d986cc023903 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:19.847874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9ea6f908-5117-4f8c-958b-d986cc023903 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:19.857042 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9ea6f908-5117-4f8c-958b-d986cc023903 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.461417 Sep 06 04:36:19.857724 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 82/148] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:19 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:19.871373 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d4bde377-3ea4-40ee-a92c-f3c244743311 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:19.871373 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d4bde377-3ea4-40ee-a92c-f3c244743311 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:19.871373 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4bde377-3ea4-40ee-a92c-f3c244743311 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:19.871373 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4bde377-3ea4-40ee-a92c-f3c244743311 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:19.871722 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4bde377-3ea4-40ee-a92c-f3c244743311 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:19.871722 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4bde377-3ea4-40ee-a92c-f3c244743311 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:19.871722 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4bde377-3ea4-40ee-a92c-f3c244743311 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:19.871722 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4bde377-3ea4-40ee-a92c-f3c244743311 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:20.085073 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d4bde377-3ea4-40ee-a92c-f3c244743311 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:20.093224 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d4bde377-3ea4-40ee-a92c-f3c244743311 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.234495 Sep 06 04:36:20.093846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 83/149] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:19 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:20.564096 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-3e58fcc2-a212-48bd-b441-6dff992a4ce2 req-583edcc0-5035-43c8-b711-17a82e2aaa16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53238a8f-2601-4952-acd2-4dcb02761c12", "tag": "19322183-60e8-44ac-b690-7448dfce3250"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:36:20.573458 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3e58fcc2-a212-48bd-b441-6dff992a4ce2 req-583edcc0-5035-43c8-b711-17a82e2aaa16 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:20.574728 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3e58fcc2-a212-48bd-b441-6dff992a4ce2 req-583edcc0-5035-43c8-b711-17a82e2aaa16 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:20.575245 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3e58fcc2-a212-48bd-b441-6dff992a4ce2 req-583edcc0-5035-43c8-b711-17a82e2aaa16 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:20.586550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-3e58fcc2-a212-48bd-b441-6dff992a4ce2 req-583edcc0-5035-43c8-b711-17a82e2aaa16 service nova] Creating event network-changed:19322183-60e8-44ac-b690-7448dfce3250 for instance 53238a8f-2601-4952-acd2-4dcb02761c12 on hv-cinder-85600 Sep 06 04:36:20.591873 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-3e58fcc2-a212-48bd-b441-6dff992a4ce2 req-583edcc0-5035-43c8-b711-17a82e2aaa16 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031438 Sep 06 04:36:20.592396 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 84/150] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:36:20.880365 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ebc61fde-0310-495b-baf2-2170d9ef5df3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:20.880975 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ebc61fde-0310-495b-baf2-2170d9ef5df3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:20.888005 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebc61fde-0310-495b-baf2-2170d9ef5df3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:20.888483 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebc61fde-0310-495b-baf2-2170d9ef5df3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:20.888914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebc61fde-0310-495b-baf2-2170d9ef5df3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:20.889616 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebc61fde-0310-495b-baf2-2170d9ef5df3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:20.890064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebc61fde-0310-495b-baf2-2170d9ef5df3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:20.890479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebc61fde-0310-495b-baf2-2170d9ef5df3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:21.026074 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ebc61fde-0310-495b-baf2-2170d9ef5df3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:21.036577 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ebc61fde-0310-495b-baf2-2170d9ef5df3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.160691 Sep 06 04:36:21.040245 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 85/151] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:20 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:21.118348 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-78e1948b-4da9-4461-a593-ef577a984bed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:21.119260 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-78e1948b-4da9-4461-a593-ef577a984bed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:21.127716 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78e1948b-4da9-4461-a593-ef577a984bed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:21.128551 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78e1948b-4da9-4461-a593-ef577a984bed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:21.129252 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78e1948b-4da9-4461-a593-ef577a984bed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:21.132237 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78e1948b-4da9-4461-a593-ef577a984bed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:21.132237 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78e1948b-4da9-4461-a593-ef577a984bed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:21.132237 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78e1948b-4da9-4461-a593-ef577a984bed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:21.273947 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-78e1948b-4da9-4461-a593-ef577a984bed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:21.284641 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-78e1948b-4da9-4461-a593-ef577a984bed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.171491 Sep 06 04:36:21.296664 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 86/152] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:21 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:22.064183 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-987eb27c-67c9-4977-8fac-84ef51eff705 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:22.064824 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-987eb27c-67c9-4977-8fac-84ef51eff705 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:22.070790 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-987eb27c-67c9-4977-8fac-84ef51eff705 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:22.071267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-987eb27c-67c9-4977-8fac-84ef51eff705 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:22.071696 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-987eb27c-67c9-4977-8fac-84ef51eff705 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:22.072376 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-987eb27c-67c9-4977-8fac-84ef51eff705 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:22.072821 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-987eb27c-67c9-4977-8fac-84ef51eff705 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:22.073290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-987eb27c-67c9-4977-8fac-84ef51eff705 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:22.206171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-987eb27c-67c9-4977-8fac-84ef51eff705 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:22.213787 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-987eb27c-67c9-4977-8fac-84ef51eff705 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1367 microversion: 2.1 time: 0.153553 Sep 06 04:36:22.215704 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 87/153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:22 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:22.292545 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dec31267-11db-491c-afdd-a4fa4fa8a3dd tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "POST /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.644407 Sep 06 04:36:22.293764 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 67/154] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Sep 6 04:36:16 2022] POST /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716/os-volume_attachments => generated 194 bytes in 5646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:36:22.307825 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-07df68c6-0f37-4065-87db-d0c9bb4134c5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:22.308571 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-07df68c6-0f37-4065-87db-d0c9bb4134c5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:22.316033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07df68c6-0f37-4065-87db-d0c9bb4134c5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:22.316511 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07df68c6-0f37-4065-87db-d0c9bb4134c5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:22.316939 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07df68c6-0f37-4065-87db-d0c9bb4134c5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:22.317647 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07df68c6-0f37-4065-87db-d0c9bb4134c5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:22.318093 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07df68c6-0f37-4065-87db-d0c9bb4134c5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:22.318505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07df68c6-0f37-4065-87db-d0c9bb4134c5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:22.568668 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-07df68c6-0f37-4065-87db-d0c9bb4134c5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:22.580720 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-07df68c6-0f37-4065-87db-d0c9bb4134c5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.276626 Sep 06 04:36:22.581722 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 88/155] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:22 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:23.238691 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8834d153-5f74-40de-b83b-c217ac155e9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:23.239567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8834d153-5f74-40de-b83b-c217ac155e9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:23.247267 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8834d153-5f74-40de-b83b-c217ac155e9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:23.247759 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8834d153-5f74-40de-b83b-c217ac155e9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:23.248193 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8834d153-5f74-40de-b83b-c217ac155e9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:23.248890 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8834d153-5f74-40de-b83b-c217ac155e9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:23.249436 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8834d153-5f74-40de-b83b-c217ac155e9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:23.249883 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8834d153-5f74-40de-b83b-c217ac155e9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:23.402853 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8834d153-5f74-40de-b83b-c217ac155e9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:23.415100 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8834d153-5f74-40de-b83b-c217ac155e9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1558 microversion: 2.1 time: 0.181081 Sep 06 04:36:23.415680 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 68/156] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:23 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1558 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:23.439262 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c6fbf6aa-2226-46af-94c4-ddc593b17399 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:23.440029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c6fbf6aa-2226-46af-94c4-ddc593b17399 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:23.446825 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c6fbf6aa-2226-46af-94c4-ddc593b17399 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:23.447267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c6fbf6aa-2226-46af-94c4-ddc593b17399 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:23.447738 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c6fbf6aa-2226-46af-94c4-ddc593b17399 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:23.448433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c6fbf6aa-2226-46af-94c4-ddc593b17399 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:23.450440 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c6fbf6aa-2226-46af-94c4-ddc593b17399 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:23.450872 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c6fbf6aa-2226-46af-94c4-ddc593b17399 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:23.545463 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c6fbf6aa-2226-46af-94c4-ddc593b17399 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103169 Sep 06 04:36:23.545463 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 89/157] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Sep 6 04:36:23 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:36:23.609505 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3324f31b-f33f-432a-8cb7-d29bbc602606 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:23.610112 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3324f31b-f33f-432a-8cb7-d29bbc602606 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:23.616538 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3324f31b-f33f-432a-8cb7-d29bbc602606 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:23.617020 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3324f31b-f33f-432a-8cb7-d29bbc602606 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:23.617484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3324f31b-f33f-432a-8cb7-d29bbc602606 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:23.618161 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3324f31b-f33f-432a-8cb7-d29bbc602606 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:23.618611 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3324f31b-f33f-432a-8cb7-d29bbc602606 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:23.619081 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3324f31b-f33f-432a-8cb7-d29bbc602606 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:24.255362 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3324f31b-f33f-432a-8cb7-d29bbc602606 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:24.268042 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3324f31b-f33f-432a-8cb7-d29bbc602606 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.662696 Sep 06 04:36:24.269552 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 69/158] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:23 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:25.293367 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b7967932-a8da-4918-be32-a1639e899bf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:25.293989 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b7967932-a8da-4918-be32-a1639e899bf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:25.300001 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7967932-a8da-4918-be32-a1639e899bf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:25.303410 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7967932-a8da-4918-be32-a1639e899bf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:25.303410 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7967932-a8da-4918-be32-a1639e899bf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:25.303410 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7967932-a8da-4918-be32-a1639e899bf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:25.303410 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7967932-a8da-4918-be32-a1639e899bf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:25.303794 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7967932-a8da-4918-be32-a1639e899bf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:25.491040 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b7967932-a8da-4918-be32-a1639e899bf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:25.499651 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b7967932-a8da-4918-be32-a1639e899bf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.211329 Sep 06 04:36:25.500645 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 90/159] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:25 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:26.061997 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-0b65ce75-1760-44ca-bc6f-f9b9d5edae78 req-65c0a034-dcf7-4805-8524-d6761454cb64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "655e54ca-b46d-40ea-a544-c796990772d7", "tag": "f88cebc5-b6a7-4ea8-9133-58a12f404543"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:36:26.073068 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0b65ce75-1760-44ca-bc6f-f9b9d5edae78 req-65c0a034-dcf7-4805-8524-d6761454cb64 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:26.074392 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0b65ce75-1760-44ca-bc6f-f9b9d5edae78 req-65c0a034-dcf7-4805-8524-d6761454cb64 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:26.075209 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0b65ce75-1760-44ca-bc6f-f9b9d5edae78 req-65c0a034-dcf7-4805-8524-d6761454cb64 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:26.090679 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-0b65ce75-1760-44ca-bc6f-f9b9d5edae78 req-65c0a034-dcf7-4805-8524-d6761454cb64 service nova] Creating event network-changed:f88cebc5-b6a7-4ea8-9133-58a12f404543 for instance 655e54ca-b46d-40ea-a544-c796990772d7 on hv-cinder-85600 Sep 06 04:36:26.096027 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-0b65ce75-1760-44ca-bc6f-f9b9d5edae78 req-65c0a034-dcf7-4805-8524-d6761454cb64 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038550 Sep 06 04:36:26.096628 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 70/160] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:36:26.524792 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b7466d17-35ec-4fea-b0c2-9daf1b8b7806 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:26.525440 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b7466d17-35ec-4fea-b0c2-9daf1b8b7806 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:26.531537 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7466d17-35ec-4fea-b0c2-9daf1b8b7806 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:26.532023 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7466d17-35ec-4fea-b0c2-9daf1b8b7806 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:26.532453 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7466d17-35ec-4fea-b0c2-9daf1b8b7806 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:26.533287 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7466d17-35ec-4fea-b0c2-9daf1b8b7806 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:26.533771 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7466d17-35ec-4fea-b0c2-9daf1b8b7806 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:26.534188 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b7466d17-35ec-4fea-b0c2-9daf1b8b7806 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:26.740268 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b7466d17-35ec-4fea-b0c2-9daf1b8b7806 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:26.754088 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b7466d17-35ec-4fea-b0c2-9daf1b8b7806 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.232750 Sep 06 04:36:26.755509 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 91/161] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:26 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:27.781271 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ebe14ef5-b9c8-49d3-b0ba-ff5a438ca42f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:27.782034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ebe14ef5-b9c8-49d3-b0ba-ff5a438ca42f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:27.784467 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=87 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:36:27.789891 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebe14ef5-b9c8-49d3-b0ba-ff5a438ca42f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:27.790382 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebe14ef5-b9c8-49d3-b0ba-ff5a438ca42f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:27.790859 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebe14ef5-b9c8-49d3-b0ba-ff5a438ca42f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:27.791561 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebe14ef5-b9c8-49d3-b0ba-ff5a438ca42f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:27.792064 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebe14ef5-b9c8-49d3-b0ba-ff5a438ca42f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:27.793097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ebe14ef5-b9c8-49d3-b0ba-ff5a438ca42f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:27.935690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ebe14ef5-b9c8-49d3-b0ba-ff5a438ca42f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:27.944032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ebe14ef5-b9c8-49d3-b0ba-ff5a438ca42f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.167878 Sep 06 04:36:27.944552 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 71/162] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:27 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:28.967656 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ea6e7ec6-3fdd-4348-97cf-c4fd1d46e39a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:28.968251 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ea6e7ec6-3fdd-4348-97cf-c4fd1d46e39a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:28.974555 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ea6e7ec6-3fdd-4348-97cf-c4fd1d46e39a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:28.974851 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ea6e7ec6-3fdd-4348-97cf-c4fd1d46e39a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:28.975276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ea6e7ec6-3fdd-4348-97cf-c4fd1d46e39a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:28.975952 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ea6e7ec6-3fdd-4348-97cf-c4fd1d46e39a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:28.976393 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ea6e7ec6-3fdd-4348-97cf-c4fd1d46e39a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:28.976806 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ea6e7ec6-3fdd-4348-97cf-c4fd1d46e39a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:29.117426 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ea6e7ec6-3fdd-4348-97cf-c4fd1d46e39a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:29.126743 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ea6e7ec6-3fdd-4348-97cf-c4fd1d46e39a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.163512 Sep 06 04:36:29.127844 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 92/163] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:28 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:30.161073 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2311a1ae-fffe-4eda-9984-2ebb6e456459 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:30.162439 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2311a1ae-fffe-4eda-9984-2ebb6e456459 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:30.173219 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2311a1ae-fffe-4eda-9984-2ebb6e456459 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:30.180086 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2311a1ae-fffe-4eda-9984-2ebb6e456459 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:30.180086 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2311a1ae-fffe-4eda-9984-2ebb6e456459 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:30.180086 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2311a1ae-fffe-4eda-9984-2ebb6e456459 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:30.180086 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2311a1ae-fffe-4eda-9984-2ebb6e456459 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:30.180454 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2311a1ae-fffe-4eda-9984-2ebb6e456459 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:30.362379 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2311a1ae-fffe-4eda-9984-2ebb6e456459 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:30.374354 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2311a1ae-fffe-4eda-9984-2ebb6e456459 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.220796 Sep 06 04:36:30.374970 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 72/164] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:30 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:31.399132 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d7a897ad-a89e-4209-8c65-a8f6c5a9e8b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:31.400284 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d7a897ad-a89e-4209-8c65-a8f6c5a9e8b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:31.407667 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7a897ad-a89e-4209-8c65-a8f6c5a9e8b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:31.408155 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7a897ad-a89e-4209-8c65-a8f6c5a9e8b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:31.408586 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7a897ad-a89e-4209-8c65-a8f6c5a9e8b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:31.409527 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7a897ad-a89e-4209-8c65-a8f6c5a9e8b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:31.410017 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7a897ad-a89e-4209-8c65-a8f6c5a9e8b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:31.410457 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d7a897ad-a89e-4209-8c65-a8f6c5a9e8b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:31.555748 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d7a897ad-a89e-4209-8c65-a8f6c5a9e8b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:31.564240 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d7a897ad-a89e-4209-8c65-a8f6c5a9e8b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.169597 Sep 06 04:36:31.565134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 93/165] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:31 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:32.586671 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4ff3662d-4e12-44a3-9374-08fb9fdc2a75 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:32.587277 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4ff3662d-4e12-44a3-9374-08fb9fdc2a75 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:32.593889 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ff3662d-4e12-44a3-9374-08fb9fdc2a75 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:32.594373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ff3662d-4e12-44a3-9374-08fb9fdc2a75 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:32.594807 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ff3662d-4e12-44a3-9374-08fb9fdc2a75 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:32.595483 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ff3662d-4e12-44a3-9374-08fb9fdc2a75 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:32.595934 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ff3662d-4e12-44a3-9374-08fb9fdc2a75 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:32.596351 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ff3662d-4e12-44a3-9374-08fb9fdc2a75 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:32.729043 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4ff3662d-4e12-44a3-9374-08fb9fdc2a75 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:32.739083 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4ff3662d-4e12-44a3-9374-08fb9fdc2a75 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.156027 Sep 06 04:36:32.739942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 73/166] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:32 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:33.763868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0b22a109-e404-4401-84ce-e4e044317698 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:33.764683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0b22a109-e404-4401-84ce-e4e044317698 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:33.773204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b22a109-e404-4401-84ce-e4e044317698 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:33.773786 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b22a109-e404-4401-84ce-e4e044317698 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:33.774247 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b22a109-e404-4401-84ce-e4e044317698 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:33.775327 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b22a109-e404-4401-84ce-e4e044317698 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:33.775781 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b22a109-e404-4401-84ce-e4e044317698 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:33.776290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b22a109-e404-4401-84ce-e4e044317698 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:33.909707 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0b22a109-e404-4401-84ce-e4e044317698 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:33.917862 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0b22a109-e404-4401-84ce-e4e044317698 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.158383 Sep 06 04:36:33.918422 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 94/167] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:33 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:34.483559 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-89ccec88-a9d8-4a26-9cdb-1469104bbfe0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:34.484133 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-89ccec88-a9d8-4a26-9cdb-1469104bbfe0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:34.492168 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-89ccec88-a9d8-4a26-9cdb-1469104bbfe0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:34.492553 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-89ccec88-a9d8-4a26-9cdb-1469104bbfe0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:34.492998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-89ccec88-a9d8-4a26-9cdb-1469104bbfe0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:34.493709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-89ccec88-a9d8-4a26-9cdb-1469104bbfe0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:34.494380 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-89ccec88-a9d8-4a26-9cdb-1469104bbfe0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:34.497577 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-89ccec88-a9d8-4a26-9cdb-1469104bbfe0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:34.523608 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-89ccec88-a9d8-4a26-9cdb-1469104bbfe0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:36:34.941614 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1bd1e2ec-d993-4a59-a713-b2e8de57106a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:34.942224 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1bd1e2ec-d993-4a59-a713-b2e8de57106a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:34.945711 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-89ccec88-a9d8-4a26-9cdb-1469104bbfe0 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "DELETE /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 204 len: 0 microversion: 2.1 time: 0.465709 Sep 06 04:36:34.946818 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 74/168] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:36:34 2022] DELETE /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:36:34.948296 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bd1e2ec-d993-4a59-a713-b2e8de57106a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:34.948776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bd1e2ec-d993-4a59-a713-b2e8de57106a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:34.949212 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bd1e2ec-d993-4a59-a713-b2e8de57106a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:34.955612 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bd1e2ec-d993-4a59-a713-b2e8de57106a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:34.956483 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bd1e2ec-d993-4a59-a713-b2e8de57106a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:34.956664 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-59546733-7869-476b-a022-c73481bcb9e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:34.956931 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bd1e2ec-d993-4a59-a713-b2e8de57106a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:34.957447 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-59546733-7869-476b-a022-c73481bcb9e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:34.964264 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-59546733-7869-476b-a022-c73481bcb9e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:34.964743 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-59546733-7869-476b-a022-c73481bcb9e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:34.965208 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-59546733-7869-476b-a022-c73481bcb9e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:34.966210 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-59546733-7869-476b-a022-c73481bcb9e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:34.966890 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-59546733-7869-476b-a022-c73481bcb9e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:34.967309 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-59546733-7869-476b-a022-c73481bcb9e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:35.132467 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-59546733-7869-476b-a022-c73481bcb9e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:35.140713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-59546733-7869-476b-a022-c73481bcb9e3 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1554 microversion: 2.1 time: 0.188781 Sep 06 04:36:35.141208 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1bd1e2ec-d993-4a59-a713-b2e8de57106a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:35.141935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 75/169] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:34 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:35.149940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1bd1e2ec-d993-4a59-a713-b2e8de57106a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.211815 Sep 06 04:36:35.150504 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 95/170] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:34 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:36.166873 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0da9b971-77b5-4283-a01c-7f51206998ba tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:36.167946 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0da9b971-77b5-4283-a01c-7f51206998ba tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:36.176457 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-28f23a61-8aed-4262-8bfb-71cf3612a391 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:36.177261 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-28f23a61-8aed-4262-8bfb-71cf3612a391 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:36.186822 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0da9b971-77b5-4283-a01c-7f51206998ba tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:36.186991 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28f23a61-8aed-4262-8bfb-71cf3612a391 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:36.187360 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0da9b971-77b5-4283-a01c-7f51206998ba tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:36.187529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28f23a61-8aed-4262-8bfb-71cf3612a391 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:36.188029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28f23a61-8aed-4262-8bfb-71cf3612a391 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:36.188163 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0da9b971-77b5-4283-a01c-7f51206998ba tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:36.188853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28f23a61-8aed-4262-8bfb-71cf3612a391 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:36.188980 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0da9b971-77b5-4283-a01c-7f51206998ba tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:36.189423 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0da9b971-77b5-4283-a01c-7f51206998ba tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:36.195518 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28f23a61-8aed-4262-8bfb-71cf3612a391 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:36.195802 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0da9b971-77b5-4283-a01c-7f51206998ba tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:36.195881 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-28f23a61-8aed-4262-8bfb-71cf3612a391 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:36.335319 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0da9b971-77b5-4283-a01c-7f51206998ba tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:36.344466 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0da9b971-77b5-4283-a01c-7f51206998ba tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1554 microversion: 2.1 time: 0.183161 Sep 06 04:36:36.345048 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 76/171] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:36 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:36.345713 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-28f23a61-8aed-4262-8bfb-71cf3612a391 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:36.354049 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-28f23a61-8aed-4262-8bfb-71cf3612a391 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.183600 Sep 06 04:36:36.354823 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 96/172] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:36 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:37.372446 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-236e33c0-efa1-467f-b831-7de232724acc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:37.373266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-236e33c0-efa1-467f-b831-7de232724acc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:37.381112 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-236e33c0-efa1-467f-b831-7de232724acc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:37.382042 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-236e33c0-efa1-467f-b831-7de232724acc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:37.382708 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-236e33c0-efa1-467f-b831-7de232724acc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:37.383522 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f0d84b21-95e3-49f6-9118-5729871e92c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:37.383982 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-236e33c0-efa1-467f-b831-7de232724acc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:37.384249 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-236e33c0-efa1-467f-b831-7de232724acc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:37.384728 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-236e33c0-efa1-467f-b831-7de232724acc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:37.385686 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f0d84b21-95e3-49f6-9118-5729871e92c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:37.393373 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0d84b21-95e3-49f6-9118-5729871e92c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:37.393856 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0d84b21-95e3-49f6-9118-5729871e92c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:37.394359 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0d84b21-95e3-49f6-9118-5729871e92c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:37.395154 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0d84b21-95e3-49f6-9118-5729871e92c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:37.395799 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0d84b21-95e3-49f6-9118-5729871e92c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:37.396291 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f0d84b21-95e3-49f6-9118-5729871e92c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:37.545206 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f0d84b21-95e3-49f6-9118-5729871e92c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:37.554019 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f0d84b21-95e3-49f6-9118-5729871e92c2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.177585 Sep 06 04:36:37.554914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 97/173] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:37 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:37.591981 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-236e33c0-efa1-467f-b831-7de232724acc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:37.603992 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-236e33c0-efa1-467f-b831-7de232724acc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1554 microversion: 2.1 time: 0.235463 Sep 06 04:36:37.604607 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 77/174] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:37 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1554 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:38.577539 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6bc62633-7e6a-461e-ad35-b01b4ff9c091 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:38.578844 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6bc62633-7e6a-461e-ad35-b01b4ff9c091 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:38.584965 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6bc62633-7e6a-461e-ad35-b01b4ff9c091 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:38.585516 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6bc62633-7e6a-461e-ad35-b01b4ff9c091 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:38.585948 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6bc62633-7e6a-461e-ad35-b01b4ff9c091 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:38.586644 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6bc62633-7e6a-461e-ad35-b01b4ff9c091 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:38.587095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6bc62633-7e6a-461e-ad35-b01b4ff9c091 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:38.588698 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6bc62633-7e6a-461e-ad35-b01b4ff9c091 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:38.630653 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a6fc7f4b-63f0-4445-a7fc-1e981e868899 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:38.635020 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a6fc7f4b-63f0-4445-a7fc-1e981e868899 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:38.644162 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6fc7f4b-63f0-4445-a7fc-1e981e868899 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:38.644652 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6fc7f4b-63f0-4445-a7fc-1e981e868899 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:38.645401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6fc7f4b-63f0-4445-a7fc-1e981e868899 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:38.646008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6fc7f4b-63f0-4445-a7fc-1e981e868899 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:38.648361 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6fc7f4b-63f0-4445-a7fc-1e981e868899 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:38.648361 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6fc7f4b-63f0-4445-a7fc-1e981e868899 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:38.783948 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6bc62633-7e6a-461e-ad35-b01b4ff9c091 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:38.788071 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:36:38.793504 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6bc62633-7e6a-461e-ad35-b01b4ff9c091 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.219680 Sep 06 04:36:38.794357 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 98/175] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:38 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:38.864074 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a6fc7f4b-63f0-4445-a7fc-1e981e868899 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:38.876500 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a6fc7f4b-63f0-4445-a7fc-1e981e868899 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1512 microversion: 2.1 time: 0.250093 Sep 06 04:36:38.877341 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-a55be2e2-1d2c-4c52-9d1b-4bda2b436afe req-511fde22-3294-4ef3-a622-90a4db800d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e4b2e8-d999-4a8f-90f7-cb565ec5c716", "name": "network-vif-deleted", "tag": "6f3d018c-b1db-426d-bceb-91b09c7660bd"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:36:38.879159 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 78/176] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:38 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1512 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:38.886884 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-a55be2e2-1d2c-4c52-9d1b-4bda2b436afe req-511fde22-3294-4ef3-a622-90a4db800d67 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:38.887302 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-a55be2e2-1d2c-4c52-9d1b-4bda2b436afe req-511fde22-3294-4ef3-a622-90a4db800d67 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:38.887889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-a55be2e2-1d2c-4c52-9d1b-4bda2b436afe req-511fde22-3294-4ef3-a622-90a4db800d67 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:38.903610 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-a55be2e2-1d2c-4c52-9d1b-4bda2b436afe req-511fde22-3294-4ef3-a622-90a4db800d67 service nova] Creating event network-vif-deleted:6f3d018c-b1db-426d-bceb-91b09c7660bd for instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 on hv-cinder-85600 Sep 06 04:36:38.909871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-a55be2e2-1d2c-4c52-9d1b-4bda2b436afe req-511fde22-3294-4ef3-a622-90a4db800d67 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036141 Sep 06 04:36:38.917431 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 99/177] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:36:39.819718 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-499a57fe-6ecd-4ee7-a3fa-bcefc028197e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:39.820309 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-499a57fe-6ecd-4ee7-a3fa-bcefc028197e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:39.826717 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-499a57fe-6ecd-4ee7-a3fa-bcefc028197e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:39.827201 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-499a57fe-6ecd-4ee7-a3fa-bcefc028197e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:39.827636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-499a57fe-6ecd-4ee7-a3fa-bcefc028197e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:39.828941 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-499a57fe-6ecd-4ee7-a3fa-bcefc028197e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:39.829433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-499a57fe-6ecd-4ee7-a3fa-bcefc028197e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:39.829856 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-499a57fe-6ecd-4ee7-a3fa-bcefc028197e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:39.902492 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8615640d-fd35-487e-89cc-f5d7f7efc6c4 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:39.903276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8615640d-fd35-487e-89cc-f5d7f7efc6c4 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:39.911754 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8615640d-fd35-487e-89cc-f5d7f7efc6c4 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:39.912473 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8615640d-fd35-487e-89cc-f5d7f7efc6c4 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:39.913179 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8615640d-fd35-487e-89cc-f5d7f7efc6c4 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:39.913892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8615640d-fd35-487e-89cc-f5d7f7efc6c4 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:39.914486 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8615640d-fd35-487e-89cc-f5d7f7efc6c4 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:39.915211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8615640d-fd35-487e-89cc-f5d7f7efc6c4 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:39.953707 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8615640d-fd35-487e-89cc-f5d7f7efc6c4 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:39.954571 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8615640d-fd35-487e-89cc-f5d7f7efc6c4 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:39.955010 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8615640d-fd35-487e-89cc-f5d7f7efc6c4 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:39.955459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-8615640d-fd35-487e-89cc-f5d7f7efc6c4 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lazy-loading 'fault' on Instance uuid 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:36:40.011615 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-499a57fe-6ecd-4ee7-a3fa-bcefc028197e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:40.017898 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8615640d-fd35-487e-89cc-f5d7f7efc6c4 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:40.019287 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-499a57fe-6ecd-4ee7-a3fa-bcefc028197e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.203413 Sep 06 04:36:40.020235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 79/178] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:39 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:40.027459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8615640d-fd35-487e-89cc-f5d7f7efc6c4 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1351 microversion: 2.1 time: 0.129858 Sep 06 04:36:40.029720 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 100/179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:39 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:41.042773 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fb797b2c-831c-4f5d-93ab-469388cb58ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:41.043379 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fb797b2c-831c-4f5d-93ab-469388cb58ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:41.050301 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb797b2c-831c-4f5d-93ab-469388cb58ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:41.051039 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb797b2c-831c-4f5d-93ab-469388cb58ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:41.051489 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb797b2c-831c-4f5d-93ab-469388cb58ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:41.052174 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb797b2c-831c-4f5d-93ab-469388cb58ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:41.052790 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb797b2c-831c-4f5d-93ab-469388cb58ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:41.053392 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb797b2c-831c-4f5d-93ab-469388cb58ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:41.056148 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a3876208-34ef-46ca-bbea-1d57e9905882 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:41.056769 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a3876208-34ef-46ca-bbea-1d57e9905882 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:41.057637 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:36:41.064308 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3876208-34ef-46ca-bbea-1d57e9905882 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:41.064795 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3876208-34ef-46ca-bbea-1d57e9905882 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:41.066535 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3876208-34ef-46ca-bbea-1d57e9905882 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:41.066535 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3876208-34ef-46ca-bbea-1d57e9905882 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:41.066535 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3876208-34ef-46ca-bbea-1d57e9905882 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:41.066939 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3876208-34ef-46ca-bbea-1d57e9905882 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:41.102148 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3876208-34ef-46ca-bbea-1d57e9905882 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:41.102633 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3876208-34ef-46ca-bbea-1d57e9905882 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:41.103072 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3876208-34ef-46ca-bbea-1d57e9905882 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:41.103519 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-a3876208-34ef-46ca-bbea-1d57e9905882 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lazy-loading 'fault' on Instance uuid 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:36:41.151740 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a3876208-34ef-46ca-bbea-1d57e9905882 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:41.161344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a3876208-34ef-46ca-bbea-1d57e9905882 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1351 microversion: 2.1 time: 0.109265 Sep 06 04:36:41.169452 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 101/180] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:41 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1351 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:41.192173 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fb797b2c-831c-4f5d-93ab-469388cb58ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:41.200422 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fb797b2c-831c-4f5d-93ab-469388cb58ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.161398 Sep 06 04:36:41.200998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 80/181] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:41 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:42.184118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-260384d5-b3e9-46cf-b476-a550cb23e739 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:42.184715 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-260384d5-b3e9-46cf-b476-a550cb23e739 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:42.191203 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-260384d5-b3e9-46cf-b476-a550cb23e739 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:42.191675 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-260384d5-b3e9-46cf-b476-a550cb23e739 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:42.192095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-260384d5-b3e9-46cf-b476-a550cb23e739 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:42.192766 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-260384d5-b3e9-46cf-b476-a550cb23e739 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:42.193218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-260384d5-b3e9-46cf-b476-a550cb23e739 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:42.193822 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-260384d5-b3e9-46cf-b476-a550cb23e739 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:42.224651 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0d53ee56-2b13-4fa2-9931-902c43f55fb9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:42.225184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-260384d5-b3e9-46cf-b476-a550cb23e739 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:42.225184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-260384d5-b3e9-46cf-b476-a550cb23e739 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:42.225374 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0d53ee56-2b13-4fa2-9931-902c43f55fb9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:42.225586 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-260384d5-b3e9-46cf-b476-a550cb23e739 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:42.226022 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-260384d5-b3e9-46cf-b476-a550cb23e739 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lazy-loading 'fault' on Instance uuid 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:36:42.231646 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d53ee56-2b13-4fa2-9931-902c43f55fb9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:42.232130 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d53ee56-2b13-4fa2-9931-902c43f55fb9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:42.232568 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d53ee56-2b13-4fa2-9931-902c43f55fb9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:42.233290 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d53ee56-2b13-4fa2-9931-902c43f55fb9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:42.233761 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d53ee56-2b13-4fa2-9931-902c43f55fb9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:42.234184 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d53ee56-2b13-4fa2-9931-902c43f55fb9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:42.265552 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-260384d5-b3e9-46cf-b476-a550cb23e739 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:42.274380 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-260384d5-b3e9-46cf-b476-a550cb23e739 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1351 microversion: 2.1 time: 0.094303 Sep 06 04:36:42.275234 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 102/182] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:42 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:42.367483 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0d53ee56-2b13-4fa2-9931-902c43f55fb9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:42.375120 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0d53ee56-2b13-4fa2-9931-902c43f55fb9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.154479 Sep 06 04:36:42.375714 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 81/183] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:42 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:43.298532 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8bb5ce88-258c-4c11-9571-13ff34f8dbf6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:43.299144 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8bb5ce88-258c-4c11-9571-13ff34f8dbf6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:43.304973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8bb5ce88-258c-4c11-9571-13ff34f8dbf6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:43.305508 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8bb5ce88-258c-4c11-9571-13ff34f8dbf6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:43.305932 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8bb5ce88-258c-4c11-9571-13ff34f8dbf6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:43.306596 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8bb5ce88-258c-4c11-9571-13ff34f8dbf6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:43.307044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8bb5ce88-258c-4c11-9571-13ff34f8dbf6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:43.307446 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8bb5ce88-258c-4c11-9571-13ff34f8dbf6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:43.337595 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8bb5ce88-258c-4c11-9571-13ff34f8dbf6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:43.338057 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8bb5ce88-258c-4c11-9571-13ff34f8dbf6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:43.338477 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8bb5ce88-258c-4c11-9571-13ff34f8dbf6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:43.338907 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-8bb5ce88-258c-4c11-9571-13ff34f8dbf6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lazy-loading 'fault' on Instance uuid 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:36:43.378103 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8bb5ce88-258c-4c11-9571-13ff34f8dbf6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:43.386304 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8bb5ce88-258c-4c11-9571-13ff34f8dbf6 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1351 microversion: 2.1 time: 0.092166 Sep 06 04:36:43.386868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 103/184] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:43 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:43.398922 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b8be1313-0b9c-45a7-b254-2b77444bba17 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:43.399790 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b8be1313-0b9c-45a7-b254-2b77444bba17 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:43.406134 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8be1313-0b9c-45a7-b254-2b77444bba17 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:43.406610 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8be1313-0b9c-45a7-b254-2b77444bba17 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:43.407595 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8be1313-0b9c-45a7-b254-2b77444bba17 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:43.408442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8be1313-0b9c-45a7-b254-2b77444bba17 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:43.408899 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8be1313-0b9c-45a7-b254-2b77444bba17 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:43.409335 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8be1313-0b9c-45a7-b254-2b77444bba17 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:43.537906 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b8be1313-0b9c-45a7-b254-2b77444bba17 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:43.545504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b8be1313-0b9c-45a7-b254-2b77444bba17 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.150367 Sep 06 04:36:43.546012 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 82/185] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:43 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:44.409984 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-75a27e3d-2ca5-4033-9d20-446a76054e45 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:44.410608 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-75a27e3d-2ca5-4033-9d20-446a76054e45 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:44.416756 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75a27e3d-2ca5-4033-9d20-446a76054e45 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:44.417240 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75a27e3d-2ca5-4033-9d20-446a76054e45 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:44.417714 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75a27e3d-2ca5-4033-9d20-446a76054e45 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:44.418401 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75a27e3d-2ca5-4033-9d20-446a76054e45 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:44.418859 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75a27e3d-2ca5-4033-9d20-446a76054e45 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:44.419281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75a27e3d-2ca5-4033-9d20-446a76054e45 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:44.449545 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75a27e3d-2ca5-4033-9d20-446a76054e45 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:44.450020 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75a27e3d-2ca5-4033-9d20-446a76054e45 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:44.450459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75a27e3d-2ca5-4033-9d20-446a76054e45 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:44.450901 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-75a27e3d-2ca5-4033-9d20-446a76054e45 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lazy-loading 'fault' on Instance uuid 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:36:44.490370 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-75a27e3d-2ca5-4033-9d20-446a76054e45 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15eebbd8b1d44f4897acb266633998db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96ba8ad37f17481a9691031fefbc3c80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:44.499403 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-75a27e3d-2ca5-4033-9d20-446a76054e45 tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 200 len: 1351 microversion: 2.1 time: 0.093911 Sep 06 04:36:44.501981 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 104/186] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:44 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:44.568403 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6149f440-5944-4b57-9966-cf039e9d47e2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:44.569048 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6149f440-5944-4b57-9966-cf039e9d47e2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:44.575571 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6149f440-5944-4b57-9966-cf039e9d47e2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:44.576045 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6149f440-5944-4b57-9966-cf039e9d47e2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:44.576512 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6149f440-5944-4b57-9966-cf039e9d47e2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:44.577187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6149f440-5944-4b57-9966-cf039e9d47e2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:44.577667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6149f440-5944-4b57-9966-cf039e9d47e2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:44.578083 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6149f440-5944-4b57-9966-cf039e9d47e2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:44.702564 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6149f440-5944-4b57-9966-cf039e9d47e2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:44.710941 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6149f440-5944-4b57-9966-cf039e9d47e2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.146444 Sep 06 04:36:44.711497 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 83/187] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:44 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:45.522911 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4be9b93a-f8c1-4393-85fb-6b1f636eb4de tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:45.523507 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4be9b93a-f8c1-4393-85fb-6b1f636eb4de tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:45.529717 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4be9b93a-f8c1-4393-85fb-6b1f636eb4de tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:45.530193 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4be9b93a-f8c1-4393-85fb-6b1f636eb4de tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:45.530687 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4be9b93a-f8c1-4393-85fb-6b1f636eb4de tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:45.531371 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4be9b93a-f8c1-4393-85fb-6b1f636eb4de tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:45.531813 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4be9b93a-f8c1-4393-85fb-6b1f636eb4de tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:45.532225 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4be9b93a-f8c1-4393-85fb-6b1f636eb4de tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:45.546425 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-4be9b93a-f8c1-4393-85fb-6b1f636eb4de tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] HTTP exception thrown: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4be9b93a-f8c1-4393-85fb-6b1f636eb4de tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Request method failure captured: Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 HTTP/1.1 Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs4VR7IaIVn3Gr9CN9bNP-Qu6VN0x2sUUZ7286o4H4EehsULH41bd7_xK4KdV7PgoN4wsyJ7HXGp62oRIsb7bZpAsZZCh1ZmVWbQx5WrDeFYzzQHTG2eGo1nfg18l0M6yetLFN4aqTBM1QemqKThiTh28RJx843Lgkw98NqOab84z60 Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 96ba8ad37f17481a9691031fefbc3c80 Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-DeleteServersTestJSON-1003658923 Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:36:45.553290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:36:45.554611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:36:45.554611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-DeleteServersTestJSON-1003658923 Sep 06 04:36:45.554611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 96ba8ad37f17481a9691031fefbc3c80 Sep 06 04:36:45.554611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003658923 Sep 06 04:36:45.554611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-DeleteServersTestJSON-1003658923-project Sep 06 04:36:45.554611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:36:45.554611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:36:45.554611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 15eebbd8b1d44f4897acb266633998db Sep 06 04:36:45.554611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-DeleteServersTestJSON-1003658923-project Sep 06 04:36:45.554611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:36:45.554611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:45.554611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '04e4b2e8-d999-4a8f-90f7-cb565ec5c716'} Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:36:45.555325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:45.556735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:36:45.558083 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4be9b93a-f8c1-4393-85fb-6b1f636eb4de tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Returning 404 to user: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:36:45.558083 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4be9b93a-f8c1-4393-85fb-6b1f636eb4de tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 404 len: 111 microversion: 2.1 time: 0.036247 Sep 06 04:36:45.558083 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 105/188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:45 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 04:36:45.682696 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f55d92f6-bec5-401c-9048-75f632533b5f tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:45.684951 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f55d92f6-bec5-401c-9048-75f632533b5f tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:45.692308 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f55d92f6-bec5-401c-9048-75f632533b5f tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:45.692792 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f55d92f6-bec5-401c-9048-75f632533b5f tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:45.693225 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f55d92f6-bec5-401c-9048-75f632533b5f tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:45.693938 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f55d92f6-bec5-401c-9048-75f632533b5f tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:45.694397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f55d92f6-bec5-401c-9048-75f632533b5f tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:45.694819 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f55d92f6-bec5-401c-9048-75f632533b5f tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:45.708188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-f55d92f6-bec5-401c-9048-75f632533b5f tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] HTTP exception thrown: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f55d92f6-bec5-401c-9048-75f632533b5f tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Request method failure captured: Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716/os-volume_attachments HTTP/1.1 Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4VR7IaIVn3Gr9CN9bNP-Qu6VN0x2sUUZ7286o4H4EehsULH41bd7_xK4KdV7PgoN4wsyJ7HXGp62oRIsb7bZpAsZZCh1ZmVWbQx5WrDeFYzzQHTG2eGo1nfg18l0M6yetLFN4aqTBM1QemqKThiTh28RJx843Lgkw98NqOab84z60 Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 96ba8ad37f17481a9691031fefbc3c80 Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-DeleteServersTestJSON-1003658923 Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:36:45.719427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:36:45.720879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:36:45.720879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-DeleteServersTestJSON-1003658923 Sep 06 04:36:45.720879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 96ba8ad37f17481a9691031fefbc3c80 Sep 06 04:36:45.720879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003658923 Sep 06 04:36:45.720879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-DeleteServersTestJSON-1003658923-project Sep 06 04:36:45.720879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:36:45.720879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:36:45.720879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 15eebbd8b1d44f4897acb266633998db Sep 06 04:36:45.720879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-DeleteServersTestJSON-1003658923-project Sep 06 04:36:45.720879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:36:45.720879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:45.720879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'server_id': '04e4b2e8-d999-4a8f-90f7-cb565ec5c716'} Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:36:45.722282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:45.723578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:36:45.725082 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f55d92f6-bec5-401c-9048-75f632533b5f tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Returning 404 to user: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:36:45.725082 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f55d92f6-bec5-401c-9048-75f632533b5f tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042660 Sep 06 04:36:45.725082 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 84/189] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:36:45 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:36:45.734150 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-01fd7e8a-bd66-46cf-8da4-9818430bc65b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:45.734785 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-01fd7e8a-bd66-46cf-8da4-9818430bc65b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:45.742037 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01fd7e8a-bd66-46cf-8da4-9818430bc65b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:45.742513 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01fd7e8a-bd66-46cf-8da4-9818430bc65b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:45.742937 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01fd7e8a-bd66-46cf-8da4-9818430bc65b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:45.743610 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01fd7e8a-bd66-46cf-8da4-9818430bc65b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:45.744052 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01fd7e8a-bd66-46cf-8da4-9818430bc65b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:45.744463 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-01fd7e8a-bd66-46cf-8da4-9818430bc65b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:45.903364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-01fd7e8a-bd66-46cf-8da4-9818430bc65b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:45.911847 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-01fd7e8a-bd66-46cf-8da4-9818430bc65b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.181530 Sep 06 04:36:45.912492 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 106/190] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:45 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:46.935234 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e8e0864a-e65d-421f-9e83-1b4477c9aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:46.935896 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e8e0864a-e65d-421f-9e83-1b4477c9aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:46.942420 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8e0864a-e65d-421f-9e83-1b4477c9aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:46.942905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8e0864a-e65d-421f-9e83-1b4477c9aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:46.943344 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8e0864a-e65d-421f-9e83-1b4477c9aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:46.944034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8e0864a-e65d-421f-9e83-1b4477c9aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:46.944487 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8e0864a-e65d-421f-9e83-1b4477c9aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:46.944908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8e0864a-e65d-421f-9e83-1b4477c9aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:47.083745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e8e0864a-e65d-421f-9e83-1b4477c9aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:47.091645 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e8e0864a-e65d-421f-9e83-1b4477c9aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.160681 Sep 06 04:36:47.092208 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 85/191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:46 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:47.174276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d74d42ef-bf92-469e-95bb-552e4ad3676a tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:47.174814 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d74d42ef-bf92-469e-95bb-552e4ad3676a tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:47.181218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d74d42ef-bf92-469e-95bb-552e4ad3676a tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:47.181736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d74d42ef-bf92-469e-95bb-552e4ad3676a tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:47.182216 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d74d42ef-bf92-469e-95bb-552e4ad3676a tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:47.182903 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d74d42ef-bf92-469e-95bb-552e4ad3676a tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:47.183357 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d74d42ef-bf92-469e-95bb-552e4ad3676a tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:47.183781 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d74d42ef-bf92-469e-95bb-552e4ad3676a tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:47.197620 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-d74d42ef-bf92-469e-95bb-552e4ad3676a tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] HTTP exception thrown: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d74d42ef-bf92-469e-95bb-552e4ad3676a tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Request method failure captured: Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 HTTP/1.1 Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs4VR7IaIVn3Gr9CN9bNP-Qu6VN0x2sUUZ7286o4H4EehsULH41bd7_xK4KdV7PgoN4wsyJ7HXGp62oRIsb7bZpAsZZCh1ZmVWbQx5WrDeFYzzQHTG2eGo1nfg18l0M6yetLFN4aqTBM1QemqKThiTh28RJx843Lgkw98NqOab84z60 Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 96ba8ad37f17481a9691031fefbc3c80 Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-DeleteServersTestJSON-1003658923 Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:36:47.199209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:36:47.200500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:36:47.200500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-DeleteServersTestJSON-1003658923 Sep 06 04:36:47.200500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 96ba8ad37f17481a9691031fefbc3c80 Sep 06 04:36:47.200500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003658923 Sep 06 04:36:47.200500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-DeleteServersTestJSON-1003658923-project Sep 06 04:36:47.200500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:36:47.200500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:36:47.200500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 15eebbd8b1d44f4897acb266633998db Sep 06 04:36:47.200500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-DeleteServersTestJSON-1003658923-project Sep 06 04:36:47.200500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:36:47.200500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:47.200500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '04e4b2e8-d999-4a8f-90f7-cb565ec5c716'} Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:36:47.202046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:47.205496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:36:47.207146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d74d42ef-bf92-469e-95bb-552e4ad3676a tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Returning 404 to user: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:36:47.207146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d74d42ef-bf92-469e-95bb-552e4ad3676a tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "DELETE /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 404 len: 111 microversion: 2.1 time: 0.030364 Sep 06 04:36:47.207146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 107/192] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:36:47 2022] DELETE /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:36:47.212353 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f65e0c1e-14fd-4e42-9864-226ec1ea3cfc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:47.212959 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f65e0c1e-14fd-4e42-9864-226ec1ea3cfc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] [instance: 04e4b2e8-d999-4a8f-90f7-cb565ec5c716] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:47.219342 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f65e0c1e-14fd-4e42-9864-226ec1ea3cfc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:47.222680 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f65e0c1e-14fd-4e42-9864-226ec1ea3cfc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:47.222680 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f65e0c1e-14fd-4e42-9864-226ec1ea3cfc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:47.222680 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f65e0c1e-14fd-4e42-9864-226ec1ea3cfc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:47.222680 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f65e0c1e-14fd-4e42-9864-226ec1ea3cfc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:47.223228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f65e0c1e-14fd-4e42-9864-226ec1ea3cfc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:47.239046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-f65e0c1e-14fd-4e42-9864-226ec1ea3cfc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] HTTP exception thrown: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f65e0c1e-14fd-4e42-9864-226ec1ea3cfc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Request method failure captured: Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 HTTP/1.1 Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4VR7IaIVn3Gr9CN9bNP-Qu6VN0x2sUUZ7286o4H4EehsULH41bd7_xK4KdV7PgoN4wsyJ7HXGp62oRIsb7bZpAsZZCh1ZmVWbQx5WrDeFYzzQHTG2eGo1nfg18l0M6yetLFN4aqTBM1QemqKThiTh28RJx843Lgkw98NqOab84z60 Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 96ba8ad37f17481a9691031fefbc3c80 Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-DeleteServersTestJSON-1003658923 Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:36:47.243688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:36:47.244942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/96ba8ad37f17481a9691031fefbc3c80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:36:47.244942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-DeleteServersTestJSON-1003658923 Sep 06 04:36:47.244942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 96ba8ad37f17481a9691031fefbc3c80 Sep 06 04:36:47.244942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-DeleteServersTestJSON-1003658923 Sep 06 04:36:47.244942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-DeleteServersTestJSON-1003658923-project Sep 06 04:36:47.244942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:36:47.244942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:36:47.244942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 15eebbd8b1d44f4897acb266633998db Sep 06 04:36:47.244942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-DeleteServersTestJSON-1003658923-project Sep 06 04:36:47.244942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:36:47.244942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:47.244942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '04e4b2e8-d999-4a8f-90f7-cb565ec5c716'} Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:36:47.251638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. Sep 06 04:36:47.267705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:36:47.276200 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f65e0c1e-14fd-4e42-9864-226ec1ea3cfc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] Returning 404 to user: Instance 04e4b2e8-d999-4a8f-90f7-cb565ec5c716 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:36:47.276200 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f65e0c1e-14fd-4e42-9864-226ec1ea3cfc tempest-DeleteServersTestJSON-1003658923 tempest-DeleteServersTestJSON-1003658923-project] 10.222.0.30 "GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716" status: 404 len: 111 microversion: 2.1 time: 0.036765 Sep 06 04:36:47.276200 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 86/193] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:47 2022] GET /compute/v2.1/servers/04e4b2e8-d999-4a8f-90f7-cb565ec5c716 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:36:48.116366 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-48f04fd3-5138-4324-bebc-236deb8e0f6f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:48.121012 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-48f04fd3-5138-4324-bebc-236deb8e0f6f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:48.123468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48f04fd3-5138-4324-bebc-236deb8e0f6f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:48.123867 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48f04fd3-5138-4324-bebc-236deb8e0f6f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:48.124291 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48f04fd3-5138-4324-bebc-236deb8e0f6f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:48.124969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48f04fd3-5138-4324-bebc-236deb8e0f6f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:48.125438 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48f04fd3-5138-4324-bebc-236deb8e0f6f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:48.125855 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48f04fd3-5138-4324-bebc-236deb8e0f6f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:48.269531 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-48f04fd3-5138-4324-bebc-236deb8e0f6f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:48.278157 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-48f04fd3-5138-4324-bebc-236deb8e0f6f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.166245 Sep 06 04:36:48.278793 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 108/194] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:48 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:49.309354 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cef39fdb-f08d-47e9-ab73-d2467909b63d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:49.309354 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cef39fdb-f08d-47e9-ab73-d2467909b63d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:49.319852 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cef39fdb-f08d-47e9-ab73-d2467909b63d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:49.320610 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cef39fdb-f08d-47e9-ab73-d2467909b63d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:49.321234 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cef39fdb-f08d-47e9-ab73-d2467909b63d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:49.322142 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cef39fdb-f08d-47e9-ab73-d2467909b63d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:49.323031 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cef39fdb-f08d-47e9-ab73-d2467909b63d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:49.323458 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cef39fdb-f08d-47e9-ab73-d2467909b63d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:49.548533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cef39fdb-f08d-47e9-ab73-d2467909b63d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:49.556372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cef39fdb-f08d-47e9-ab73-d2467909b63d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.257665 Sep 06 04:36:49.556935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 87/195] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:49 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:50.580039 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f24abf9e-d9f9-4bbf-bf47-c011b911607e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:50.580639 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f24abf9e-d9f9-4bbf-bf47-c011b911607e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:50.582928 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=69 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:36:50.588400 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f24abf9e-d9f9-4bbf-bf47-c011b911607e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:50.594291 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f24abf9e-d9f9-4bbf-bf47-c011b911607e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:50.594291 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f24abf9e-d9f9-4bbf-bf47-c011b911607e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:50.594291 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f24abf9e-d9f9-4bbf-bf47-c011b911607e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:50.594291 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f24abf9e-d9f9-4bbf-bf47-c011b911607e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:50.594789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f24abf9e-d9f9-4bbf-bf47-c011b911607e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:50.742451 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f24abf9e-d9f9-4bbf-bf47-c011b911607e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:50.757936 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f24abf9e-d9f9-4bbf-bf47-c011b911607e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.181641 Sep 06 04:36:50.758519 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 109/196] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:50 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:51.784400 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c7db12a4-937a-4ea2-87d8-4e3a055ce7b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:51.785386 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c7db12a4-937a-4ea2-87d8-4e3a055ce7b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:51.793135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7db12a4-937a-4ea2-87d8-4e3a055ce7b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:51.794103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7db12a4-937a-4ea2-87d8-4e3a055ce7b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:51.794642 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7db12a4-937a-4ea2-87d8-4e3a055ce7b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:51.795335 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7db12a4-937a-4ea2-87d8-4e3a055ce7b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:51.795783 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7db12a4-937a-4ea2-87d8-4e3a055ce7b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:51.796196 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7db12a4-937a-4ea2-87d8-4e3a055ce7b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:51.948248 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c7db12a4-937a-4ea2-87d8-4e3a055ce7b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:51.956717 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c7db12a4-937a-4ea2-87d8-4e3a055ce7b1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.177574 Sep 06 04:36:51.957277 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 88/197] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:51 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:52.980618 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0939c112-1f80-4902-93b0-ece0c63fe579 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:52.981219 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0939c112-1f80-4902-93b0-ece0c63fe579 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:52.987889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0939c112-1f80-4902-93b0-ece0c63fe579 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:52.988536 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0939c112-1f80-4902-93b0-ece0c63fe579 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:52.989060 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0939c112-1f80-4902-93b0-ece0c63fe579 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:52.989788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0939c112-1f80-4902-93b0-ece0c63fe579 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:52.990241 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0939c112-1f80-4902-93b0-ece0c63fe579 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:52.990656 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0939c112-1f80-4902-93b0-ece0c63fe579 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:53.126234 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0939c112-1f80-4902-93b0-ece0c63fe579 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:53.134723 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0939c112-1f80-4902-93b0-ece0c63fe579 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.158093 Sep 06 04:36:53.135286 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 110/198] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:52 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:53.670823 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-430c316d-2c13-4988-a32c-e666950b6eee tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Action: 'create', calling method: .version_select at 0x7f3176663700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1387167484"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:36:54.159264 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3be158d7-88b2-4723-9933-cb045ca30096 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:54.160304 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3be158d7-88b2-4723-9933-cb045ca30096 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:54.166773 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3be158d7-88b2-4723-9933-cb045ca30096 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:54.167184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3be158d7-88b2-4723-9933-cb045ca30096 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:54.167607 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3be158d7-88b2-4723-9933-cb045ca30096 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:54.168284 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3be158d7-88b2-4723-9933-cb045ca30096 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:54.168786 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3be158d7-88b2-4723-9933-cb045ca30096 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:54.169200 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3be158d7-88b2-4723-9933-cb045ca30096 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:54.309700 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3be158d7-88b2-4723-9933-cb045ca30096 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:54.319847 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3be158d7-88b2-4723-9933-cb045ca30096 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.164582 Sep 06 04:36:54.320433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 111/199] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:54 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:36:54.472367 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-430c316d-2c13-4988-a32c-e666950b6eee tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.932631 Sep 06 04:36:54.473092 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 89/200] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Sep 6 04:36:53 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 934 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 06 04:36:54.486103 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-172912b3-2113-4eb2-a528-5734149bae0a tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f31767035e0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:54.537935 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-172912b3-2113-4eb2-a528-5734149bae0a tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 200 len: 345 microversion: 2.1 time: 0.055432 Sep 06 04:36:54.539001 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 112/201] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:36:54 2022] GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:36:55.344119 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ea973f5b-93ab-4702-98a1-7290b6dfddd5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:55.344726 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ea973f5b-93ab-4702-98a1-7290b6dfddd5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:55.351717 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea973f5b-93ab-4702-98a1-7290b6dfddd5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:55.352217 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea973f5b-93ab-4702-98a1-7290b6dfddd5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:55.352645 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea973f5b-93ab-4702-98a1-7290b6dfddd5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:55.353367 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea973f5b-93ab-4702-98a1-7290b6dfddd5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:55.353822 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea973f5b-93ab-4702-98a1-7290b6dfddd5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:55.354266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea973f5b-93ab-4702-98a1-7290b6dfddd5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:55.496303 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ea973f5b-93ab-4702-98a1-7290b6dfddd5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:55.505283 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ea973f5b-93ab-4702-98a1-7290b6dfddd5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.165317 Sep 06 04:36:55.505784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 90/202] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:55 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:55.554111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d84f5c6d-d198-4516-b38d-41e0bb279a71 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176703e50>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:55.604462 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d84f5c6d-d198-4516-b38d-41e0bb279a71 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 200 len: 345 microversion: 2.1 time: 0.052023 Sep 06 04:36:55.607790 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 113/203] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:36:55 2022] GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:36:56.529844 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f62c1242-63cd-4e28-a347-aa3ea117525a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:56.530511 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f62c1242-63cd-4e28-a347-aa3ea117525a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:56.537852 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f62c1242-63cd-4e28-a347-aa3ea117525a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:56.538339 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f62c1242-63cd-4e28-a347-aa3ea117525a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:56.538777 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f62c1242-63cd-4e28-a347-aa3ea117525a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:56.539465 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f62c1242-63cd-4e28-a347-aa3ea117525a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:56.539918 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f62c1242-63cd-4e28-a347-aa3ea117525a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:56.540343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f62c1242-63cd-4e28-a347-aa3ea117525a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:56.624270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-83fbfb79-6cf6-4a2e-9c5e-5e92fd9669d1 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176710280>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:56.680096 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f62c1242-63cd-4e28-a347-aa3ea117525a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:56.690904 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-83fbfb79-6cf6-4a2e-9c5e-5e92fd9669d1 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 200 len: 345 microversion: 2.1 time: 0.070523 Sep 06 04:36:56.692909 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f62c1242-63cd-4e28-a347-aa3ea117525a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.166854 Sep 06 04:36:56.693915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 114/204] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:36:56 2022] GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:36:56.694133 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 91/205] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:56 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:57.716591 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7f28e28e-27a5-4608-bceb-790c96423b1f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:57.717298 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7f28e28e-27a5-4608-bceb-790c96423b1f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:57.719248 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cabb29b5-41e5-4fbf-907e-c68e1f461d39 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f31766b5f70>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:57.725331 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f28e28e-27a5-4608-bceb-790c96423b1f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:57.725834 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f28e28e-27a5-4608-bceb-790c96423b1f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:57.726268 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f28e28e-27a5-4608-bceb-790c96423b1f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:57.727305 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f28e28e-27a5-4608-bceb-790c96423b1f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:57.727785 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f28e28e-27a5-4608-bceb-790c96423b1f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:57.728214 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7f28e28e-27a5-4608-bceb-790c96423b1f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:57.774926 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cabb29b5-41e5-4fbf-907e-c68e1f461d39 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 200 len: 345 microversion: 2.1 time: 0.058929 Sep 06 04:36:57.782215 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 92/206] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:36:57 2022] GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:36:57.860909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7f28e28e-27a5-4608-bceb-790c96423b1f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:57.869537 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7f28e28e-27a5-4608-bceb-790c96423b1f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.156720 Sep 06 04:36:57.870106 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 115/207] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:57 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:58.789897 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0be81a89-0129-4dd9-998e-ee2d820500aa tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f31767f04c0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:58.837881 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0be81a89-0129-4dd9-998e-ee2d820500aa tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 200 len: 345 microversion: 2.1 time: 0.052136 Sep 06 04:36:58.838449 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 93/208] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:36:58 2022] GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:36:58.892252 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c08f01e0-c153-4f50-8dcb-101f711ee012 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:58.892855 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c08f01e0-c153-4f50-8dcb-101f711ee012 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:36:58.899327 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c08f01e0-c153-4f50-8dcb-101f711ee012 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:58.900065 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c08f01e0-c153-4f50-8dcb-101f711ee012 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:58.900496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c08f01e0-c153-4f50-8dcb-101f711ee012 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:58.901171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c08f01e0-c153-4f50-8dcb-101f711ee012 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:36:58.901648 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c08f01e0-c153-4f50-8dcb-101f711ee012 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:36:58.902071 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c08f01e0-c153-4f50-8dcb-101f711ee012 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:36:59.030601 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c08f01e0-c153-4f50-8dcb-101f711ee012 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:36:59.039227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c08f01e0-c153-4f50-8dcb-101f711ee012 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.150732 Sep 06 04:36:59.039971 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 116/209] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:36:58 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:36:59.853130 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-79ec069a-26b2-4a47-827b-98088dc92357 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176661550>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:36:59.900188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-79ec069a-26b2-4a47-827b-98088dc92357 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 200 len: 345 microversion: 2.1 time: 0.051007 Sep 06 04:36:59.900752 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 94/210] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:36:59 2022] GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:00.062217 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4fc07b2d-5fbe-4a91-a127-df3b6476d5c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:00.062904 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4fc07b2d-5fbe-4a91-a127-df3b6476d5c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:00.069482 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4fc07b2d-5fbe-4a91-a127-df3b6476d5c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:00.069960 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4fc07b2d-5fbe-4a91-a127-df3b6476d5c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:00.070393 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4fc07b2d-5fbe-4a91-a127-df3b6476d5c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:00.071069 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4fc07b2d-5fbe-4a91-a127-df3b6476d5c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:00.071518 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4fc07b2d-5fbe-4a91-a127-df3b6476d5c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:00.071936 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4fc07b2d-5fbe-4a91-a127-df3b6476d5c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:00.202935 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4fc07b2d-5fbe-4a91-a127-df3b6476d5c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:00.210542 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4fc07b2d-5fbe-4a91-a127-df3b6476d5c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.152173 Sep 06 04:37:00.214248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 117/211] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:00 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:00.915410 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-372c8ed8-f3fa-4999-a497-743f1a36aa40 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f31766b59d0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:00.961930 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-372c8ed8-f3fa-4999-a497-743f1a36aa40 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 200 len: 345 microversion: 2.1 time: 0.051277 Sep 06 04:37:00.962498 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 95/212] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:37:00 2022] GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:01.235024 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-09a0d8d8-02a3-42a7-94e0-d6ad05c5acb6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:01.235695 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-09a0d8d8-02a3-42a7-94e0-d6ad05c5acb6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:01.242069 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-09a0d8d8-02a3-42a7-94e0-d6ad05c5acb6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:01.242542 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-09a0d8d8-02a3-42a7-94e0-d6ad05c5acb6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:01.242964 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-09a0d8d8-02a3-42a7-94e0-d6ad05c5acb6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:01.243671 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-09a0d8d8-02a3-42a7-94e0-d6ad05c5acb6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:01.244116 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-09a0d8d8-02a3-42a7-94e0-d6ad05c5acb6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:01.244523 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-09a0d8d8-02a3-42a7-94e0-d6ad05c5acb6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:01.378554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-09a0d8d8-02a3-42a7-94e0-d6ad05c5acb6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:01.383031 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:37:01.389914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-09a0d8d8-02a3-42a7-94e0-d6ad05c5acb6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.158757 Sep 06 04:37:01.390504 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 118/213] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:01 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:01.976777 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b48d6483-9053-417f-af2e-b3e71912a464 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176663c10>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:02.036501 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b48d6483-9053-417f-af2e-b3e71912a464 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 200 len: 346 microversion: 2.1 time: 0.064311 Sep 06 04:37:02.037067 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 96/214] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:37:01 2022] GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:02.055277 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0308384f-d7df-4258-9b3a-142cd5e0d537 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Action: 'create', calling method: .version_select at 0x7f317669c940>, body: {"snapshot": {"volume_id": "b9680c68-1b7d-4a2e-ac56-812fcceae419", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1063387196"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:37:02.414716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-787b9b28-0ffd-45cc-9929-6b74bd9932db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:02.415330 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-787b9b28-0ffd-45cc-9929-6b74bd9932db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:02.422000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:37:02.423453 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-787b9b28-0ffd-45cc-9929-6b74bd9932db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:02.424106 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-787b9b28-0ffd-45cc-9929-6b74bd9932db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:02.424600 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-787b9b28-0ffd-45cc-9929-6b74bd9932db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:02.425322 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-787b9b28-0ffd-45cc-9929-6b74bd9932db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:02.425795 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-787b9b28-0ffd-45cc-9929-6b74bd9932db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:02.426404 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-787b9b28-0ffd-45cc-9929-6b74bd9932db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:02.486299 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0308384f-d7df-4258-9b3a-142cd5e0d537 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.436365 Sep 06 04:37:02.486873 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 119/215] 10.222.0.30 () {60 vars in 1162 bytes} [Tue Sep 6 04:37:02 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:02.502260 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-52589621-d590-46d8-adfc-9a56673177d0 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176849af0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:02.550419 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-52589621-d590-46d8-adfc-9a56673177d0 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.052135 Sep 06 04:37:02.550984 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 120/216] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:02 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:37:02.562897 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-abfdb808-09a4-4c49-b348-b03bcc2f3949 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176710a60>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:02.601344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-abfdb808-09a4-4c49-b348-b03bcc2f3949 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.041763 Sep 06 04:37:02.602534 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 121/217] 10.222.0.30 () {58 vars in 1140 bytes} [Tue Sep 6 04:37:02 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:37:02.611097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-787b9b28-0ffd-45cc-9929-6b74bd9932db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:02.614439 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d0340a54-76e2-4c49-8e6f-de630c1bc81a tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176849160>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:02.619619 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-787b9b28-0ffd-45cc-9929-6b74bd9932db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.209103 Sep 06 04:37:02.620270 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 97/218] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:02 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:37:02.644940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d0340a54-76e2-4c49-8e6f-de630c1bc81a tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.034270 Sep 06 04:37:02.645541 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 122/219] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:02 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:37:03.644034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5bdbf353-a37d-4534-97e2-1a80001d8684 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:03.644637 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5bdbf353-a37d-4534-97e2-1a80001d8684 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:03.652392 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bdbf353-a37d-4534-97e2-1a80001d8684 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:03.652901 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bdbf353-a37d-4534-97e2-1a80001d8684 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:03.653328 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bdbf353-a37d-4534-97e2-1a80001d8684 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:03.654000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bdbf353-a37d-4534-97e2-1a80001d8684 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:03.656267 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bdbf353-a37d-4534-97e2-1a80001d8684 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:03.656267 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bdbf353-a37d-4534-97e2-1a80001d8684 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:03.658242 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1b8fe147-3a41-476e-8f38-8035fef177c9 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176a1d0d0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:03.688337 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1b8fe147-3a41-476e-8f38-8035fef177c9 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.033945 Sep 06 04:37:03.688991 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 123/220] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:03 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:37:03.783613 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5bdbf353-a37d-4534-97e2-1a80001d8684 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:03.791343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5bdbf353-a37d-4534-97e2-1a80001d8684 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.151440 Sep 06 04:37:03.791900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 98/221] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:03 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:04.701589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b7cb088e-9ca8-43a1-8f7d-be67d9e71267 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f317669cca0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:04.733941 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b7cb088e-9ca8-43a1-8f7d-be67d9e71267 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.036358 Sep 06 04:37:04.734512 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 124/222] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:04 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:04.814295 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-03b3a665-1e0c-423f-88e3-a0b848517d69 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:04.814898 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-03b3a665-1e0c-423f-88e3-a0b848517d69 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:04.821455 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03b3a665-1e0c-423f-88e3-a0b848517d69 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:04.821942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03b3a665-1e0c-423f-88e3-a0b848517d69 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:04.822379 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03b3a665-1e0c-423f-88e3-a0b848517d69 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:04.823065 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03b3a665-1e0c-423f-88e3-a0b848517d69 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:04.823524 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03b3a665-1e0c-423f-88e3-a0b848517d69 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:04.823946 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03b3a665-1e0c-423f-88e3-a0b848517d69 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:04.961170 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-03b3a665-1e0c-423f-88e3-a0b848517d69 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:04.969463 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-03b3a665-1e0c-423f-88e3-a0b848517d69 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.158978 Sep 06 04:37:04.970032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 99/223] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:04 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:05.746805 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5cd3e2d4-164b-486f-b3e1-d862d0e987e0 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176703ca0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:05.777892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5cd3e2d4-164b-486f-b3e1-d862d0e987e0 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.034853 Sep 06 04:37:05.778460 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 125/224] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:05 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:05.994128 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-07f1ae0e-a7b0-4a4a-8dba-9860d9320244 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:05.994944 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-07f1ae0e-a7b0-4a4a-8dba-9860d9320244 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:06.003176 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07f1ae0e-a7b0-4a4a-8dba-9860d9320244 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:06.003845 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07f1ae0e-a7b0-4a4a-8dba-9860d9320244 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:06.004404 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07f1ae0e-a7b0-4a4a-8dba-9860d9320244 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:06.005452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07f1ae0e-a7b0-4a4a-8dba-9860d9320244 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:06.005922 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07f1ae0e-a7b0-4a4a-8dba-9860d9320244 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:06.006354 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07f1ae0e-a7b0-4a4a-8dba-9860d9320244 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:06.142258 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-07f1ae0e-a7b0-4a4a-8dba-9860d9320244 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:06.150398 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-07f1ae0e-a7b0-4a4a-8dba-9860d9320244 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.159762 Sep 06 04:37:06.150951 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 100/225] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:05 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:06.791082 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3fa072ff-648f-4564-8cf1-14c4c0e59582 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f317669c8b0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:06.820402 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3fa072ff-648f-4564-8cf1-14c4c0e59582 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.033525 Sep 06 04:37:06.821120 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 126/226] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:06 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:07.172657 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c7ad9d96-7f2b-4f89-8533-042169e8537c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:07.173233 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c7ad9d96-7f2b-4f89-8533-042169e8537c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:07.179607 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7ad9d96-7f2b-4f89-8533-042169e8537c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:07.180122 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7ad9d96-7f2b-4f89-8533-042169e8537c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:07.180551 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7ad9d96-7f2b-4f89-8533-042169e8537c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:07.181220 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7ad9d96-7f2b-4f89-8533-042169e8537c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:07.181689 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7ad9d96-7f2b-4f89-8533-042169e8537c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:07.182103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7ad9d96-7f2b-4f89-8533-042169e8537c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:07.452614 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c7ad9d96-7f2b-4f89-8533-042169e8537c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:07.460245 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c7ad9d96-7f2b-4f89-8533-042169e8537c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.291430 Sep 06 04:37:07.460805 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 101/227] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:07 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:07.833330 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e8a0cac4-fd51-49c8-97de-5b2d38bc62bc tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f31773f5dc0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:07.863855 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e8a0cac4-fd51-49c8-97de-5b2d38bc62bc tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.034548 Sep 06 04:37:07.864440 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 127/228] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:07 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:08.485589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c77469d5-c167-47e3-b3c9-b4aaf6c88bc2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:08.486222 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c77469d5-c167-47e3-b3c9-b4aaf6c88bc2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:08.492471 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c77469d5-c167-47e3-b3c9-b4aaf6c88bc2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:08.492993 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c77469d5-c167-47e3-b3c9-b4aaf6c88bc2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:08.493449 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c77469d5-c167-47e3-b3c9-b4aaf6c88bc2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:08.494121 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c77469d5-c167-47e3-b3c9-b4aaf6c88bc2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:08.494583 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c77469d5-c167-47e3-b3c9-b4aaf6c88bc2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:08.494979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c77469d5-c167-47e3-b3c9-b4aaf6c88bc2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:08.634130 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c77469d5-c167-47e3-b3c9-b4aaf6c88bc2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:08.641714 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c77469d5-c167-47e3-b3c9-b4aaf6c88bc2 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.159885 Sep 06 04:37:08.642278 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 102/229] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:08 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:08.876974 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-800c4de9-72df-4838-8559-c2040f591b2d tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176849790>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:08.912353 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-800c4de9-72df-4838-8559-c2040f591b2d tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.039217 Sep 06 04:37:08.912938 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 128/230] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:08 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:09.666029 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-30961486-ba42-44dc-9a63-7eeb9ac6905f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:09.666616 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-30961486-ba42-44dc-9a63-7eeb9ac6905f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:09.672881 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30961486-ba42-44dc-9a63-7eeb9ac6905f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:09.673583 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30961486-ba42-44dc-9a63-7eeb9ac6905f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:09.673812 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30961486-ba42-44dc-9a63-7eeb9ac6905f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:09.674499 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30961486-ba42-44dc-9a63-7eeb9ac6905f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:09.674950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30961486-ba42-44dc-9a63-7eeb9ac6905f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:09.675369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-30961486-ba42-44dc-9a63-7eeb9ac6905f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:09.806867 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-30961486-ba42-44dc-9a63-7eeb9ac6905f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:09.815132 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-30961486-ba42-44dc-9a63-7eeb9ac6905f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.153249 Sep 06 04:37:09.815132 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 103/231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:09 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:09.924978 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5039ff84-0208-4fb2-b653-6f15bd827005 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176703550>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:09.954467 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5039ff84-0208-4fb2-b653-6f15bd827005 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.033187 Sep 06 04:37:09.955013 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 129/232] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:09 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:10.838027 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d4c79aca-e95a-4bf8-b58e-8ecf1e75b653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:10.838625 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d4c79aca-e95a-4bf8-b58e-8ecf1e75b653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:10.845210 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4c79aca-e95a-4bf8-b58e-8ecf1e75b653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:10.845717 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4c79aca-e95a-4bf8-b58e-8ecf1e75b653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:10.846141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4c79aca-e95a-4bf8-b58e-8ecf1e75b653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:10.846832 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4c79aca-e95a-4bf8-b58e-8ecf1e75b653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:10.847258 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4c79aca-e95a-4bf8-b58e-8ecf1e75b653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:10.847669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4c79aca-e95a-4bf8-b58e-8ecf1e75b653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:10.851574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:37:10.968358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-587064b5-76e1-4644-b1b3-9a58bee018d1 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176849160>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:10.982598 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d4c79aca-e95a-4bf8-b58e-8ecf1e75b653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:10.990706 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d4c79aca-e95a-4bf8-b58e-8ecf1e75b653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.156983 Sep 06 04:37:10.991281 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 104/233] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:10 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:11.002708 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-587064b5-76e1-4644-b1b3-9a58bee018d1 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.038342 Sep 06 04:37:11.005060 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 130/234] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:10 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:12.014894 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-60319c70-af22-4fc2-a30a-d62c87ad56b3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:12.015430 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-60319c70-af22-4fc2-a30a-d62c87ad56b3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:12.016261 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-76647644-e9cd-40cf-88b6-07eea9e27fe3 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176a1d0d0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:12.022465 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60319c70-af22-4fc2-a30a-d62c87ad56b3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:12.022592 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=13 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:37:12.023262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60319c70-af22-4fc2-a30a-d62c87ad56b3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:12.023654 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60319c70-af22-4fc2-a30a-d62c87ad56b3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:12.024632 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60319c70-af22-4fc2-a30a-d62c87ad56b3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:12.025445 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60319c70-af22-4fc2-a30a-d62c87ad56b3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:12.025875 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-60319c70-af22-4fc2-a30a-d62c87ad56b3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:12.051459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-76647644-e9cd-40cf-88b6-07eea9e27fe3 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.038554 Sep 06 04:37:12.057971 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 131/235] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:12 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:37:12.173381 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-60319c70-af22-4fc2-a30a-d62c87ad56b3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:12.179106 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-60319c70-af22-4fc2-a30a-d62c87ad56b3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.168567 Sep 06 04:37:12.180170 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 105/236] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:12 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:13.065203 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-67d4824b-dd7b-41a0-98fd-24fe55af3838 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f317669cca0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:13.097090 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-67d4824b-dd7b-41a0-98fd-24fe55af3838 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.035614 Sep 06 04:37:13.097686 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 132/237] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:13 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:13.203249 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dc4a6b2a-5c19-45dd-ad5d-150020d1fcd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:13.203860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dc4a6b2a-5c19-45dd-ad5d-150020d1fcd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:13.210168 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc4a6b2a-5c19-45dd-ad5d-150020d1fcd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:13.210650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc4a6b2a-5c19-45dd-ad5d-150020d1fcd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:13.211085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc4a6b2a-5c19-45dd-ad5d-150020d1fcd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:13.212262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc4a6b2a-5c19-45dd-ad5d-150020d1fcd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:13.212718 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc4a6b2a-5c19-45dd-ad5d-150020d1fcd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:13.213141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc4a6b2a-5c19-45dd-ad5d-150020d1fcd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:13.343038 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dc4a6b2a-5c19-45dd-ad5d-150020d1fcd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:13.350751 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dc4a6b2a-5c19-45dd-ad5d-150020d1fcd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.151280 Sep 06 04:37:13.351311 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 106/238] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:13 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:14.112105 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-85fb6ee9-e4f3-46f5-8a06-a4eb42eb657e tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f31767033a0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:14.141027 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-85fb6ee9-e4f3-46f5-8a06-a4eb42eb657e tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.033046 Sep 06 04:37:14.141625 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 133/239] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:14 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:14.374301 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-73fbd092-75b8-4d9b-93dc-f649e8f41764 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:14.374900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-73fbd092-75b8-4d9b-93dc-f649e8f41764 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:14.382038 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-73fbd092-75b8-4d9b-93dc-f649e8f41764 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:14.382522 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-73fbd092-75b8-4d9b-93dc-f649e8f41764 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:14.382980 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-73fbd092-75b8-4d9b-93dc-f649e8f41764 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:14.383958 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-73fbd092-75b8-4d9b-93dc-f649e8f41764 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:14.384975 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-73fbd092-75b8-4d9b-93dc-f649e8f41764 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:14.385521 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-73fbd092-75b8-4d9b-93dc-f649e8f41764 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:14.524126 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-73fbd092-75b8-4d9b-93dc-f649e8f41764 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:14.532671 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-73fbd092-75b8-4d9b-93dc-f649e8f41764 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.162298 Sep 06 04:37:14.533226 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 107/240] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:14 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:15.154167 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-67987ecf-fdcd-4983-9335-c36579fa6612 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f317669c8b0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:15.182488 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-67987ecf-fdcd-4983-9335-c36579fa6612 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.032987 Sep 06 04:37:15.183042 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 134/241] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:15 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:15.555123 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f841f15a-ab9e-4f06-9096-256d03195f66 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:15.555731 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f841f15a-ab9e-4f06-9096-256d03195f66 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:15.562500 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f841f15a-ab9e-4f06-9096-256d03195f66 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:15.562980 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f841f15a-ab9e-4f06-9096-256d03195f66 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:15.563416 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f841f15a-ab9e-4f06-9096-256d03195f66 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:15.564132 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f841f15a-ab9e-4f06-9096-256d03195f66 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:15.564581 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f841f15a-ab9e-4f06-9096-256d03195f66 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:15.564998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f841f15a-ab9e-4f06-9096-256d03195f66 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:15.694802 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f841f15a-ab9e-4f06-9096-256d03195f66 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:15.702642 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f841f15a-ab9e-4f06-9096-256d03195f66 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.151366 Sep 06 04:37:15.707287 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 108/242] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:15 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:16.195116 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dd8a8cdd-096e-49c5-a918-cf7651f174ed tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f31773f5dc0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:16.225353 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dd8a8cdd-096e-49c5-a918-cf7651f174ed tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.033932 Sep 06 04:37:16.225882 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 135/243] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:16 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:16.726722 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2723bb46-8baf-4a0d-a1ae-c8d461540452 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:16.727334 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2723bb46-8baf-4a0d-a1ae-c8d461540452 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:16.734490 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2723bb46-8baf-4a0d-a1ae-c8d461540452 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:16.734976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2723bb46-8baf-4a0d-a1ae-c8d461540452 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:16.735444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2723bb46-8baf-4a0d-a1ae-c8d461540452 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:16.736129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2723bb46-8baf-4a0d-a1ae-c8d461540452 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:16.736585 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2723bb46-8baf-4a0d-a1ae-c8d461540452 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:16.737008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2723bb46-8baf-4a0d-a1ae-c8d461540452 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:16.870355 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2723bb46-8baf-4a0d-a1ae-c8d461540452 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:16.878971 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2723bb46-8baf-4a0d-a1ae-c8d461540452 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.156105 Sep 06 04:37:16.879570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 109/244] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:16 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:17.238483 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6f9bddbf-72c1-49dd-9ab3-b59412c9bb0a tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176849790>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:17.270216 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6f9bddbf-72c1-49dd-9ab3-b59412c9bb0a tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.035815 Sep 06 04:37:17.270929 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 136/245] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:17 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:17.904978 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c67af3cd-d930-44c9-9042-0cda8d75944d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:17.905610 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c67af3cd-d930-44c9-9042-0cda8d75944d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:17.911572 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c67af3cd-d930-44c9-9042-0cda8d75944d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:17.912076 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c67af3cd-d930-44c9-9042-0cda8d75944d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:17.918664 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c67af3cd-d930-44c9-9042-0cda8d75944d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:17.918664 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c67af3cd-d930-44c9-9042-0cda8d75944d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:17.918664 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c67af3cd-d930-44c9-9042-0cda8d75944d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:17.918664 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c67af3cd-d930-44c9-9042-0cda8d75944d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:18.043956 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c67af3cd-d930-44c9-9042-0cda8d75944d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:18.051744 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c67af3cd-d930-44c9-9042-0cda8d75944d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.152085 Sep 06 04:37:18.052303 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 110/246] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:17 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:18.283237 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-71be4dae-066b-4159-9395-722172983938 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176703b80>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:18.333763 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-71be4dae-066b-4159-9395-722172983938 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.054143 Sep 06 04:37:18.334334 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 137/247] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:18 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:19.075040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0cd84a5f-e08c-46a3-9767-3e71d154e65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:19.075579 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0cd84a5f-e08c-46a3-9767-3e71d154e65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:19.081976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0cd84a5f-e08c-46a3-9767-3e71d154e65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:19.082459 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0cd84a5f-e08c-46a3-9767-3e71d154e65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:19.082893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0cd84a5f-e08c-46a3-9767-3e71d154e65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:19.083583 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0cd84a5f-e08c-46a3-9767-3e71d154e65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:19.084036 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0cd84a5f-e08c-46a3-9767-3e71d154e65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:19.084461 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0cd84a5f-e08c-46a3-9767-3e71d154e65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:19.220220 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0cd84a5f-e08c-46a3-9767-3e71d154e65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:19.227809 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0cd84a5f-e08c-46a3-9767-3e71d154e65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.156720 Sep 06 04:37:19.229024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 111/248] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:19 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:19.347143 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ce078da1-5db4-45f3-9202-96c3ca205ca9 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176849160>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:19.382048 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ce078da1-5db4-45f3-9202-96c3ca205ca9 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.038493 Sep 06 04:37:19.382617 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 138/249] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:19 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:20.251359 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-284d8e5f-29a6-4d6e-9776-0157248b734f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:20.251952 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-284d8e5f-29a6-4d6e-9776-0157248b734f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:20.258297 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-284d8e5f-29a6-4d6e-9776-0157248b734f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:20.258777 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-284d8e5f-29a6-4d6e-9776-0157248b734f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:20.259204 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-284d8e5f-29a6-4d6e-9776-0157248b734f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:20.260423 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-284d8e5f-29a6-4d6e-9776-0157248b734f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:20.260865 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-284d8e5f-29a6-4d6e-9776-0157248b734f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:20.261280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-284d8e5f-29a6-4d6e-9776-0157248b734f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:20.394543 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-284d8e5f-29a6-4d6e-9776-0157248b734f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:20.395748 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-09911ef1-9a78-41ba-92ef-531b5e102b3b tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176a1d0d0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:20.408917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-284d8e5f-29a6-4d6e-9776-0157248b734f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.161462 Sep 06 04:37:20.409725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 112/250] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:20 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:20.433498 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-09911ef1-9a78-41ba-92ef-531b5e102b3b tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.042292 Sep 06 04:37:20.434065 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 139/251] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:20 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:37:21.431947 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e7acf80a-6a0a-4f46-a4ee-f4c13b5bb674 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:21.433020 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e7acf80a-6a0a-4f46-a4ee-f4c13b5bb674 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:21.443349 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7acf80a-6a0a-4f46-a4ee-f4c13b5bb674 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:21.443833 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7acf80a-6a0a-4f46-a4ee-f4c13b5bb674 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:21.444276 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7acf80a-6a0a-4f46-a4ee-f4c13b5bb674 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:21.445088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7acf80a-6a0a-4f46-a4ee-f4c13b5bb674 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:21.445603 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7acf80a-6a0a-4f46-a4ee-f4c13b5bb674 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:21.446026 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7acf80a-6a0a-4f46-a4ee-f4c13b5bb674 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:21.446486 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b64b40de-609e-4b00-b9ea-cb56a5d0f0c0 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f317669c9d0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:21.478788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b64b40de-609e-4b00-b9ea-cb56a5d0f0c0 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.036469 Sep 06 04:37:21.479635 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 140/252] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:21 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:37:21.582577 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e7acf80a-6a0a-4f46-a4ee-f4c13b5bb674 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:21.590242 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e7acf80a-6a0a-4f46-a4ee-f4c13b5bb674 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1521 microversion: 2.1 time: 0.162351 Sep 06 04:37:21.590798 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 113/253] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:21 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:22.491786 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-82b65503-f069-41e6-89d9-5f70ec9f7ed5 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f31767039d0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:22.521696 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-82b65503-f069-41e6-89d9-5f70ec9f7ed5 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.033746 Sep 06 04:37:22.522344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 141/254] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:22 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:22.613340 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0f55326e-0611-4cab-ac6b-234ed449d9c3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:22.613901 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0f55326e-0611-4cab-ac6b-234ed449d9c3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:22.620698 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f55326e-0611-4cab-ac6b-234ed449d9c3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:22.621182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f55326e-0611-4cab-ac6b-234ed449d9c3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:22.621645 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f55326e-0611-4cab-ac6b-234ed449d9c3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:22.622329 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f55326e-0611-4cab-ac6b-234ed449d9c3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:22.622807 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f55326e-0611-4cab-ac6b-234ed449d9c3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:22.623231 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f55326e-0611-4cab-ac6b-234ed449d9c3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:22.749158 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0f55326e-0611-4cab-ac6b-234ed449d9c3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:22.756734 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0f55326e-0611-4cab-ac6b-234ed449d9c3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1501 microversion: 2.1 time: 0.147527 Sep 06 04:37:22.757343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 114/255] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:22 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1501 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:22.780357 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8faed438-13ac-4e7b-aab3-d0f64c1bb7a3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:22.780960 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8faed438-13ac-4e7b-aab3-d0f64c1bb7a3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:22.786943 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8faed438-13ac-4e7b-aab3-d0f64c1bb7a3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:22.787423 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8faed438-13ac-4e7b-aab3-d0f64c1bb7a3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:22.787853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8faed438-13ac-4e7b-aab3-d0f64c1bb7a3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:22.788527 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8faed438-13ac-4e7b-aab3-d0f64c1bb7a3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:22.789102 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8faed438-13ac-4e7b-aab3-d0f64c1bb7a3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:22.789550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8faed438-13ac-4e7b-aab3-d0f64c1bb7a3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:22.917580 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8faed438-13ac-4e7b-aab3-d0f64c1bb7a3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:22.925290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8faed438-13ac-4e7b-aab3-d0f64c1bb7a3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1514 microversion: 2.1 time: 0.148701 Sep 06 04:37:22.925883 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 142/256] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:22 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:23.537578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3e338fec-bf28-40aa-8674-a373973d1df8 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f317698eaf0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:23.569154 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3e338fec-bf28-40aa-8674-a373973d1df8 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 288 microversion: 2.1 time: 0.035594 Sep 06 04:37:23.569858 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 115/257] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:23 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:23.581646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a01729e1-72db-4843-833b-7a40496daee5 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176825f70>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:23.738387 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a01729e1-72db-4843-833b-7a40496daee5 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 202 len: 0 microversion: 2.1 time: 0.160546 Sep 06 04:37:23.738970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 143/258] 10.222.0.30 () {58 vars in 1254 bytes} [Tue Sep 6 04:37:23 2022] DELETE /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 04:37:23.747602 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a464749c-2d42-4bbc-9679-8380ef000457 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f31769350d0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:23.778858 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a464749c-2d42-4bbc-9679-8380ef000457 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.035483 Sep 06 04:37:23.779420 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 116/259] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:23 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:24.791514 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-eb352f0f-54ce-4793-a961-0d79438f9143 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176703e50>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:24.821045 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-eb352f0f-54ce-4793-a961-0d79438f9143 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.033254 Sep 06 04:37:24.821864 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 144/260] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:24 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:25.834501 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9c2ed6c0-1ae2-42e8-9f63-bc4d55b1006f tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176893160>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:25.864497 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9c2ed6c0-1ae2-42e8-9f63-bc4d55b1006f tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.034244 Sep 06 04:37:25.865143 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 117/261] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:25 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:26.877963 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-60d0cbfc-776f-4049-b0f3-2d490829527f tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f317669c940>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:26.907806 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-60d0cbfc-776f-4049-b0f3-2d490829527f tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.033455 Sep 06 04:37:26.908345 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 145/262] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:26 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:27.921211 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-28f234cb-bbb7-4f91-829d-709bae33b41f tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f317698e0d0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:27.950624 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-28f234cb-bbb7-4f91-829d-709bae33b41f tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.033752 Sep 06 04:37:27.951213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 118/263] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:27 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:28.965111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-48ec9804-e04d-4816-ac62-49ef5df851f2 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176703d30>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:28.994555 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-48ec9804-e04d-4816-ac62-49ef5df851f2 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 200 len: 287 microversion: 2.1 time: 0.034865 Sep 06 04:37:28.995138 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 146/264] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:28 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:30.007962 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-54ba60b4-367e-406f-9d48-4b447044ca5a tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176893d30>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:30.035248 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-54ba60b4-367e-406f-9d48-4b447044ca5a tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] HTTP exception thrown: Snapshot 8fa3280e-71ce-49de-b7f0-ec10ea9caa7b could not be found. Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-54ba60b4-367e-406f-9d48-4b447044ca5a tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Request method failure captured: Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b HTTP/1.1 Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs5l6BY8T98KnIh0ay6iaDThDfhpv_1NWOcsNxTBLdDtDrFEbQxoL3qnQQZjaf0cUGKS9yzFipkUuHjp3airpczgODZnm7Vtcd4CCTTckWRe_We2s0IkowusP3mdPQfD8kGlDB9jXEcL1ykIFnS6I3MY5vR6gK2iONgJhZu9SNoJFjc Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 0f5ff30b7d70423a809d6c3701149255 Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2139392631 Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:37:30.038860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:37:30.040570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:37:30.040570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2139392631 Sep 06 04:37:30.040570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 0f5ff30b7d70423a809d6c3701149255 Sep 06 04:37:30.040570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2139392631 Sep 06 04:37:30.040570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesSnapshotsTestJSON-2139392631-project Sep 06 04:37:30.040570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:37:30.040570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:37:30.040570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 88fd2421b7cf4bf78cd6fbc209660e30 Sep 06 04:37:30.040570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2139392631-project Sep 06 04:37:30.040570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: Sep 06 04:37:30.040570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Snapshot 8fa3280e-71ce-49de-b7f0-ec10ea9caa7b could not be found. Sep 06 04:37:30.040570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '8fa3280e-71ce-49de-b7f0-ec10ea9caa7b'} Sep 06 04:37:30.040570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8fa3280e-71ce-49de-b7f0-ec10ea9caa7b could not be found. (HTTP 404) (Request-ID: req-20b5e83e-e5a1-43a3-9ec7-1db9608b4a10) Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:30.042431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 04:37:30.043636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8fa3280e-71ce-49de-b7f0-ec10ea9caa7b could not be found. Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 06 04:37:30.046633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:37:30.048476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8fa3280e-71ce-49de-b7f0-ec10ea9caa7b could not be found. Sep 06 04:37:30.048476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:30.048476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:37:30.048476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:30.048476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:30.048476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:37:30.048476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:37:30.048476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:37:30.048476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:37:30.048476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8fa3280e-71ce-49de-b7f0-ec10ea9caa7b could not be found. Sep 06 04:37:30.048476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:30.048476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-54ba60b4-367e-406f-9d48-4b447044ca5a tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Returning 404 to user: Snapshot 8fa3280e-71ce-49de-b7f0-ec10ea9caa7b could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:37:30.048476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-54ba60b4-367e-406f-9d48-4b447044ca5a tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b" status: 404 len: 111 microversion: 2.1 time: 0.037135 Sep 06 04:37:30.049298 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 119/265] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:37:30 2022] GET /compute/v2.1/os-snapshots/8fa3280e-71ce-49de-b7f0-ec10ea9caa7b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:37:30.050584 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f78e0a88-9a88-411e-a32f-b44a10886262 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176825c10>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:30.211001 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f78e0a88-9a88-411e-a32f-b44a10886262 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 202 len: 0 microversion: 2.1 time: 0.163956 Sep 06 04:37:30.211553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 147/266] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Sep 6 04:37:30 2022] DELETE /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:37:30.219807 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bc8956b6-bbae-450e-982d-f2f52ead756a tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176935040>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:30.268223 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bc8956b6-bbae-450e-982d-f2f52ead756a tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 200 len: 345 microversion: 2.1 time: 0.052071 Sep 06 04:37:30.268878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 120/267] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:37:30 2022] GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:37:31.285046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5da9b10c-e930-44fd-81e3-8be9b46a1878 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176808ca0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:31.342960 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5da9b10c-e930-44fd-81e3-8be9b46a1878 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 200 len: 345 microversion: 2.1 time: 0.062070 Sep 06 04:37:31.343965 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 148/268] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:37:31 2022] GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:32.358351 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bdcbcc1e-38ec-4df0-829c-70fdd0d68d0c tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f31767f01f0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:32.409705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bdcbcc1e-38ec-4df0-829c-70fdd0d68d0c tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 200 len: 345 microversion: 2.1 time: 0.056164 Sep 06 04:37:32.410272 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 121/269] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:37:32 2022] GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:33.149459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:37:33.150538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:37:33.155080 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-32196f92-7a9b-48f3-ba9f-569b0a7a5bbd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:37:33.157755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-32196f92-7a9b-48f3-ba9f-569b0a7a5bbd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:33.166845 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32196f92-7a9b-48f3-ba9f-569b0a7a5bbd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:33.166845 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32196f92-7a9b-48f3-ba9f-569b0a7a5bbd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:33.166845 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32196f92-7a9b-48f3-ba9f-569b0a7a5bbd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:33.166845 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32196f92-7a9b-48f3-ba9f-569b0a7a5bbd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:33.167214 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32196f92-7a9b-48f3-ba9f-569b0a7a5bbd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:33.167214 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32196f92-7a9b-48f3-ba9f-569b0a7a5bbd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:33.191296 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-32196f92-7a9b-48f3-ba9f-569b0a7a5bbd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lazy-loading 'flavor' on Instance uuid ed927594-12ef-48af-b170-5b88f8ecb0ec {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:37:33.420891 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=35 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:37:33.421630 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=64 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:37:33.426398 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3b4ca5f4-aebc-4c02-baed-c38ab1a6f15d tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f31767f08b0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:33.432959 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-32196f92-7a9b-48f3-ba9f-569b0a7a5bbd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "POST /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec/action" status: 200 len: 32 microversion: 2.1 time: 0.278677 Sep 06 04:37:33.432959 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 149/270] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Sep 6 04:37:33 2022] POST /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec/action => generated 32 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 04:37:33.438529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-43078e21-3df7-49aa-ba40-d1825d2166ea tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:33.439284 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-43078e21-3df7-49aa-ba40-d1825d2166ea tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:33.445721 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-43078e21-3df7-49aa-ba40-d1825d2166ea tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:33.446231 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-43078e21-3df7-49aa-ba40-d1825d2166ea tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:33.446664 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-43078e21-3df7-49aa-ba40-d1825d2166ea tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:33.447891 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-43078e21-3df7-49aa-ba40-d1825d2166ea tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:33.448531 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-43078e21-3df7-49aa-ba40-d1825d2166ea tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:33.449185 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-43078e21-3df7-49aa-ba40-d1825d2166ea tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:33.475524 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3b4ca5f4-aebc-4c02-baed-c38ab1a6f15d tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 200 len: 345 microversion: 2.1 time: 0.055357 Sep 06 04:37:33.476528 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 122/271] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:37:33 2022] GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:37:33.591678 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-43078e21-3df7-49aa-ba40-d1825d2166ea tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:33.599546 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-43078e21-3df7-49aa-ba40-d1825d2166ea tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.165228 Sep 06 04:37:33.600111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 150/272] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:33 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:34.489905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-df61b4d1-5e4f-4a84-abad-590c807be428 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f3176935160>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:34.545917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-df61b4d1-5e4f-4a84-abad-590c807be428 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 200 len: 345 microversion: 2.1 time: 0.059740 Sep 06 04:37:34.546926 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 123/273] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:37:34 2022] GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:34.623881 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-36796df9-fa26-4483-81d6-6387fbf7e4d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:34.624484 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-36796df9-fa26-4483-81d6-6387fbf7e4d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:34.630986 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36796df9-fa26-4483-81d6-6387fbf7e4d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:34.631466 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36796df9-fa26-4483-81d6-6387fbf7e4d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:34.631896 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36796df9-fa26-4483-81d6-6387fbf7e4d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:34.632639 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36796df9-fa26-4483-81d6-6387fbf7e4d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:34.633075 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36796df9-fa26-4483-81d6-6387fbf7e4d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:34.633537 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36796df9-fa26-4483-81d6-6387fbf7e4d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:34.776398 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-36796df9-fa26-4483-81d6-6387fbf7e4d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:34.783989 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-36796df9-fa26-4483-81d6-6387fbf7e4d3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.164001 Sep 06 04:37:34.784548 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 151/274] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:34 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:37:35.562196 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-786834b5-618d-4efc-811d-da5f31db38ba tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f31766b91f0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:35.591163 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-786834b5-618d-4efc-811d-da5f31db38ba tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] HTTP exception thrown: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-786834b5-618d-4efc-811d-da5f31db38ba tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Request method failure captured: Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 HTTP/1.1 Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs5l6BY8T98KnIh0ay6iaDThDfhpv_1NWOcsNxTBLdDtDrFEbQxoL3qnQQZjaf0cUGKS9yzFipkUuHjp3airpczgODZnm7Vtcd4CCTTckWRe_We2s0IkowusP3mdPQfD8kGlDB9jXEcL1ykIFnS6I3MY5vR6gK2iONgJhZu9SNoJFjc Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 0f5ff30b7d70423a809d6c3701149255 Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2139392631 Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:37:35.593590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:37:35.594984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:37:35.594984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2139392631 Sep 06 04:37:35.594984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 0f5ff30b7d70423a809d6c3701149255 Sep 06 04:37:35.594984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2139392631 Sep 06 04:37:35.594984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesSnapshotsTestJSON-2139392631-project Sep 06 04:37:35.594984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:37:35.594984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:37:35.594984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 88fd2421b7cf4bf78cd6fbc209660e30 Sep 06 04:37:35.594984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2139392631-project Sep 06 04:37:35.594984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: Sep 06 04:37:35.594984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. Sep 06 04:37:35.594984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': 'b9680c68-1b7d-4a2e-ac56-812fcceae419'} Sep 06 04:37:35.594984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. (HTTP 404) (Request-ID: req-426078a6-8ab4-46b1-b343-14da3680237c) Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:37:35.595893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 04:37:35.597235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 04:37:35.598504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:37:35.599503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. Sep 06 04:37:35.599503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.599503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:37:35.599503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.599503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:35.599503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:37:35.599503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:37:35.599503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:37:35.599503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:37:35.599503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. Sep 06 04:37:35.599503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.599503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-786834b5-618d-4efc-811d-da5f31db38ba tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Returning 404 to user: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:37:35.599503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-786834b5-618d-4efc-811d-da5f31db38ba tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 404 len: 109 microversion: 2.1 time: 0.037261 Sep 06 04:37:35.599503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 124/275] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:37:35 2022] GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:37:35.610408 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4a1081c5-e6f0-43d3-8994-230d829cfa42 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f317669c820>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:35.638762 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-4a1081c5-e6f0-43d3-8994-230d829cfa42 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] HTTP exception thrown: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4a1081c5-e6f0-43d3-8994-230d829cfa42 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Request method failure captured: Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 HTTP/1.1 Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs5l6BY8T98KnIh0ay6iaDThDfhpv_1NWOcsNxTBLdDtDrFEbQxoL3qnQQZjaf0cUGKS9yzFipkUuHjp3airpczgODZnm7Vtcd4CCTTckWRe_We2s0IkowusP3mdPQfD8kGlDB9jXEcL1ykIFnS6I3MY5vR6gK2iONgJhZu9SNoJFjc Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 0f5ff30b7d70423a809d6c3701149255 Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2139392631 Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:37:35.642448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:37:35.643919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:37:35.643919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2139392631 Sep 06 04:37:35.643919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 0f5ff30b7d70423a809d6c3701149255 Sep 06 04:37:35.643919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2139392631 Sep 06 04:37:35.643919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesSnapshotsTestJSON-2139392631-project Sep 06 04:37:35.643919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:37:35.643919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:37:35.643919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 88fd2421b7cf4bf78cd6fbc209660e30 Sep 06 04:37:35.643919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2139392631-project Sep 06 04:37:35.643919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: Sep 06 04:37:35.643919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. Sep 06 04:37:35.643919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': 'b9680c68-1b7d-4a2e-ac56-812fcceae419'} Sep 06 04:37:35.643919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. (HTTP 404) (Request-ID: req-388a163f-4574-4a19-8254-303c45dee9b1) Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:37:35.644779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 04:37:35.646118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 04:37:35.647204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:37:35.648276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. Sep 06 04:37:35.648276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.648276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:37:35.648276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.648276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:35.648276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:37:35.648276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:37:35.648276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:37:35.648276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:37:35.648276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. Sep 06 04:37:35.648276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.648276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4a1081c5-e6f0-43d3-8994-230d829cfa42 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Returning 404 to user: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:37:35.648276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4a1081c5-e6f0-43d3-8994-230d829cfa42 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 404 len: 109 microversion: 2.1 time: 0.037207 Sep 06 04:37:35.648276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 152/276] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Sep 6 04:37:35 2022] DELETE /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:37:35.654197 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-216fbda0-e2a9-4fbb-9178-29fb36c3ce34 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Calling method '.version_select at 0x7f31766b9040>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:35.681645 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-216fbda0-e2a9-4fbb-9178-29fb36c3ce34 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] HTTP exception thrown: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-216fbda0-e2a9-4fbb-9178-29fb36c3ce34 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Request method failure captured: Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 HTTP/1.1 Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs5l6BY8T98KnIh0ay6iaDThDfhpv_1NWOcsNxTBLdDtDrFEbQxoL3qnQQZjaf0cUGKS9yzFipkUuHjp3airpczgODZnm7Vtcd4CCTTckWRe_We2s0IkowusP3mdPQfD8kGlDB9jXEcL1ykIFnS6I3MY5vR6gK2iONgJhZu9SNoJFjc Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 0f5ff30b7d70423a809d6c3701149255 Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2139392631 Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:37:35.684192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:37:35.685662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/0f5ff30b7d70423a809d6c3701149255"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:37:35.685662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2139392631 Sep 06 04:37:35.685662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 0f5ff30b7d70423a809d6c3701149255 Sep 06 04:37:35.685662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2139392631 Sep 06 04:37:35.685662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesSnapshotsTestJSON-2139392631-project Sep 06 04:37:35.685662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:37:35.685662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:37:35.685662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 88fd2421b7cf4bf78cd6fbc209660e30 Sep 06 04:37:35.685662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2139392631-project Sep 06 04:37:35.685662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: Sep 06 04:37:35.685662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. Sep 06 04:37:35.685662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': 'b9680c68-1b7d-4a2e-ac56-812fcceae419'} Sep 06 04:37:35.685662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. (HTTP 404) (Request-ID: req-9da04061-48f0-4555-b67d-0e0aeebd9c6c) Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:37:35.688061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 04:37:35.689373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 04:37:35.690407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:37:35.691966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. Sep 06 04:37:35.691966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.691966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:37:35.691966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.691966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:35.691966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:37:35.691966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:37:35.691966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:37:35.691966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:37:35.691966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. Sep 06 04:37:35.691966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:35.691966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-216fbda0-e2a9-4fbb-9178-29fb36c3ce34 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] Returning 404 to user: Volume b9680c68-1b7d-4a2e-ac56-812fcceae419 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:37:35.691966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-216fbda0-e2a9-4fbb-9178-29fb36c3ce34 tempest-VolumesSnapshotsTestJSON-2139392631 tempest-VolumesSnapshotsTestJSON-2139392631-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419" status: 404 len: 109 microversion: 2.1 time: 0.036144 Sep 06 04:37:35.691966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 125/277] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:37:35 2022] GET /compute/v2.1/os-volumes/b9680c68-1b7d-4a2e-ac56-812fcceae419 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:37:35.811494 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9d0517cb-3842-4ccf-94db-335cc3a7dd27 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:35.812123 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9d0517cb-3842-4ccf-94db-335cc3a7dd27 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:35.823950 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d0517cb-3842-4ccf-94db-335cc3a7dd27 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:35.823950 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d0517cb-3842-4ccf-94db-335cc3a7dd27 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:35.823950 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d0517cb-3842-4ccf-94db-335cc3a7dd27 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:35.823950 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d0517cb-3842-4ccf-94db-335cc3a7dd27 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:35.824478 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d0517cb-3842-4ccf-94db-335cc3a7dd27 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:35.824478 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d0517cb-3842-4ccf-94db-335cc3a7dd27 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:35.958701 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9d0517cb-3842-4ccf-94db-335cc3a7dd27 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:35.967090 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9d0517cb-3842-4ccf-94db-335cc3a7dd27 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.163571 Sep 06 04:37:35.967652 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 153/278] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:35 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:36.990279 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c7513539-d699-44fe-98fe-8b1dba6d97f7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:36.990998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c7513539-d699-44fe-98fe-8b1dba6d97f7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:36.997795 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7513539-d699-44fe-98fe-8b1dba6d97f7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:36.998356 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7513539-d699-44fe-98fe-8b1dba6d97f7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:36.998831 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7513539-d699-44fe-98fe-8b1dba6d97f7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:36.999515 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7513539-d699-44fe-98fe-8b1dba6d97f7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:36.999967 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7513539-d699-44fe-98fe-8b1dba6d97f7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:37.000386 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7513539-d699-44fe-98fe-8b1dba6d97f7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:37.154266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c7513539-d699-44fe-98fe-8b1dba6d97f7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:37.164148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c7513539-d699-44fe-98fe-8b1dba6d97f7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.178077 Sep 06 04:37:37.164681 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 126/279] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:36 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:37:38.193474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ba1476bd-73d7-48b1-a121-76036718ccf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:38.194073 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ba1476bd-73d7-48b1-a121-76036718ccf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:38.201397 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ba1476bd-73d7-48b1-a121-76036718ccf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:38.202010 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ba1476bd-73d7-48b1-a121-76036718ccf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:38.202510 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ba1476bd-73d7-48b1-a121-76036718ccf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:38.203274 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ba1476bd-73d7-48b1-a121-76036718ccf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:38.203875 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ba1476bd-73d7-48b1-a121-76036718ccf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:38.204361 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ba1476bd-73d7-48b1-a121-76036718ccf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:38.423248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ba1476bd-73d7-48b1-a121-76036718ccf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:38.431880 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ba1476bd-73d7-48b1-a121-76036718ccf3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.242178 Sep 06 04:37:38.432687 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 154/280] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:38 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:39.455950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-45fffd11-4b29-4fd1-a091-cba900040316 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:39.456765 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-45fffd11-4b29-4fd1-a091-cba900040316 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:39.463364 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45fffd11-4b29-4fd1-a091-cba900040316 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:39.464014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45fffd11-4b29-4fd1-a091-cba900040316 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:39.464519 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45fffd11-4b29-4fd1-a091-cba900040316 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:39.465326 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45fffd11-4b29-4fd1-a091-cba900040316 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:39.465884 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45fffd11-4b29-4fd1-a091-cba900040316 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:39.466426 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-45fffd11-4b29-4fd1-a091-cba900040316 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:39.739586 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-45fffd11-4b29-4fd1-a091-cba900040316 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:39.748736 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-45fffd11-4b29-4fd1-a091-cba900040316 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.296639 Sep 06 04:37:39.753422 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 127/281] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:39 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:40.772913 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a6398d79-17f2-45c6-b8a3-dec0bf6c46c0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:40.774176 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a6398d79-17f2-45c6-b8a3-dec0bf6c46c0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:40.782102 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6398d79-17f2-45c6-b8a3-dec0bf6c46c0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:40.782881 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6398d79-17f2-45c6-b8a3-dec0bf6c46c0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:40.788915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6398d79-17f2-45c6-b8a3-dec0bf6c46c0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:40.788915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6398d79-17f2-45c6-b8a3-dec0bf6c46c0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:40.788915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6398d79-17f2-45c6-b8a3-dec0bf6c46c0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:40.788915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6398d79-17f2-45c6-b8a3-dec0bf6c46c0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:40.928743 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a6398d79-17f2-45c6-b8a3-dec0bf6c46c0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:40.939551 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a6398d79-17f2-45c6-b8a3-dec0bf6c46c0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.170741 Sep 06 04:37:40.940277 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 155/282] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:40 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:41.963429 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5cb5828d-8d0d-4337-9ea1-76048ae22bdb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:41.964409 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5cb5828d-8d0d-4337-9ea1-76048ae22bdb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:41.971500 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cb5828d-8d0d-4337-9ea1-76048ae22bdb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:41.971993 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cb5828d-8d0d-4337-9ea1-76048ae22bdb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:41.972611 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cb5828d-8d0d-4337-9ea1-76048ae22bdb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:41.973511 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cb5828d-8d0d-4337-9ea1-76048ae22bdb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:41.974073 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cb5828d-8d0d-4337-9ea1-76048ae22bdb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:41.974498 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cb5828d-8d0d-4337-9ea1-76048ae22bdb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:42.249453 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5cb5828d-8d0d-4337-9ea1-76048ae22bdb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:42.257596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5cb5828d-8d0d-4337-9ea1-76048ae22bdb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.298146 Sep 06 04:37:42.258391 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 128/283] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:41 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:43.282710 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0ec67b47-c79e-4c38-bf7d-9de27c3187b5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:43.283999 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0ec67b47-c79e-4c38-bf7d-9de27c3187b5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:43.290215 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ec67b47-c79e-4c38-bf7d-9de27c3187b5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:43.290986 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ec67b47-c79e-4c38-bf7d-9de27c3187b5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:43.291655 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ec67b47-c79e-4c38-bf7d-9de27c3187b5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:43.293439 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ec67b47-c79e-4c38-bf7d-9de27c3187b5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:43.294140 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ec67b47-c79e-4c38-bf7d-9de27c3187b5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:43.294654 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ec67b47-c79e-4c38-bf7d-9de27c3187b5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:43.446830 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0ec67b47-c79e-4c38-bf7d-9de27c3187b5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:43.455616 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0ec67b47-c79e-4c38-bf7d-9de27c3187b5 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.176612 Sep 06 04:37:43.456192 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 156/284] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:43 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:44.481892 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-10312e5f-b69d-4154-a791-c70acd0e5deb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:44.483259 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-10312e5f-b69d-4154-a791-c70acd0e5deb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:44.498790 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10312e5f-b69d-4154-a791-c70acd0e5deb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:44.499292 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10312e5f-b69d-4154-a791-c70acd0e5deb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:44.499934 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10312e5f-b69d-4154-a791-c70acd0e5deb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:44.500439 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10312e5f-b69d-4154-a791-c70acd0e5deb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:44.502761 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10312e5f-b69d-4154-a791-c70acd0e5deb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:44.504475 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10312e5f-b69d-4154-a791-c70acd0e5deb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:44.658270 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-10312e5f-b69d-4154-a791-c70acd0e5deb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:44.667549 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-10312e5f-b69d-4154-a791-c70acd0e5deb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.190674 Sep 06 04:37:44.668304 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 129/285] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:44 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:45.691900 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2bb3a6da-91a3-469e-a3cb-cf5481307af1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:45.695512 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2bb3a6da-91a3-469e-a3cb-cf5481307af1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:45.714623 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bb3a6da-91a3-469e-a3cb-cf5481307af1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:45.716285 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bb3a6da-91a3-469e-a3cb-cf5481307af1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:45.716739 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bb3a6da-91a3-469e-a3cb-cf5481307af1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:45.717492 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bb3a6da-91a3-469e-a3cb-cf5481307af1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:45.718017 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bb3a6da-91a3-469e-a3cb-cf5481307af1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:45.718440 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bb3a6da-91a3-469e-a3cb-cf5481307af1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:45.942997 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2bb3a6da-91a3-469e-a3cb-cf5481307af1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:45.955030 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2bb3a6da-91a3-469e-a3cb-cf5481307af1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.266820 Sep 06 04:37:45.958373 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 157/286] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:45 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:46.984493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4f38ab26-fb99-41ac-b449-de2f03105f52 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:46.985832 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4f38ab26-fb99-41ac-b449-de2f03105f52 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:47.007388 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f38ab26-fb99-41ac-b449-de2f03105f52 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:47.008074 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f38ab26-fb99-41ac-b449-de2f03105f52 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:47.008507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f38ab26-fb99-41ac-b449-de2f03105f52 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:47.009758 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f38ab26-fb99-41ac-b449-de2f03105f52 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:47.010358 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f38ab26-fb99-41ac-b449-de2f03105f52 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:47.013194 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f38ab26-fb99-41ac-b449-de2f03105f52 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:47.236335 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4f38ab26-fb99-41ac-b449-de2f03105f52 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:47.254059 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4f38ab26-fb99-41ac-b449-de2f03105f52 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.271433 Sep 06 04:37:47.254059 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 130/287] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:46 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:48.277482 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-eb4b0f82-286d-4c13-b299-ccc5bf233dac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:48.278427 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-eb4b0f82-286d-4c13-b299-ccc5bf233dac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:48.285025 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eb4b0f82-286d-4c13-b299-ccc5bf233dac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:48.285570 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eb4b0f82-286d-4c13-b299-ccc5bf233dac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:48.286208 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eb4b0f82-286d-4c13-b299-ccc5bf233dac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:48.287114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eb4b0f82-286d-4c13-b299-ccc5bf233dac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:48.287583 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eb4b0f82-286d-4c13-b299-ccc5bf233dac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:48.288022 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-eb4b0f82-286d-4c13-b299-ccc5bf233dac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:48.545157 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-eb4b0f82-286d-4c13-b299-ccc5bf233dac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:48.554087 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-eb4b0f82-286d-4c13-b299-ccc5bf233dac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.281491 Sep 06 04:37:48.555025 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 158/288] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:48 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:49.581888 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-77e2ab75-8540-4473-968d-201dfc22aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:49.582499 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-77e2ab75-8540-4473-968d-201dfc22aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:49.591504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77e2ab75-8540-4473-968d-201dfc22aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:49.592258 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77e2ab75-8540-4473-968d-201dfc22aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:49.592703 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77e2ab75-8540-4473-968d-201dfc22aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:49.593621 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77e2ab75-8540-4473-968d-201dfc22aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:49.594080 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77e2ab75-8540-4473-968d-201dfc22aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:49.594740 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77e2ab75-8540-4473-968d-201dfc22aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:50.067390 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-77e2ab75-8540-4473-968d-201dfc22aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:50.079605 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-77e2ab75-8540-4473-968d-201dfc22aff8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.501083 Sep 06 04:37:50.080216 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 131/289] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:49 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:37:51.110202 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-10a2b970-6c3f-4b56-8c0d-7b8825609a70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:51.110827 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-10a2b970-6c3f-4b56-8c0d-7b8825609a70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:51.122304 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10a2b970-6c3f-4b56-8c0d-7b8825609a70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:51.122862 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10a2b970-6c3f-4b56-8c0d-7b8825609a70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:51.123304 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10a2b970-6c3f-4b56-8c0d-7b8825609a70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:51.124209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10a2b970-6c3f-4b56-8c0d-7b8825609a70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:51.124701 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10a2b970-6c3f-4b56-8c0d-7b8825609a70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:51.125192 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10a2b970-6c3f-4b56-8c0d-7b8825609a70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:51.558812 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-10a2b970-6c3f-4b56-8c0d-7b8825609a70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:51.566635 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-10a2b970-6c3f-4b56-8c0d-7b8825609a70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.463099 Sep 06 04:37:51.567189 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 159/290] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:51 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:51.883443 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-92c901be-e58e-4616-a48e-483aaea768fa tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Action: 'create', calling method: .version_select at 0x7f31766b9b80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-153806682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBADmPsLhBwmjxUYeasLnUUBfgjfCzJSEmAyTnvnhuz7wyrn/2b2pnyCphIPwvJ26Kvi8KsG20TJE/+Zf8pQWB9+YJGWTn7UsBejiN9wryn/GSc6dMk7olfPMAQgtHk/L4w=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:37:51.896988 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-92c901be-e58e-4616-a48e-483aaea768fa tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Getting quotas for project 375efd2890fc4b71af13439813f00ab0. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:37:51.903769 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-92c901be-e58e-4616-a48e-483aaea768fa tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Getting quotas for user 4b6c761af9c5457ea1e481ce400aded8 and project 375efd2890fc4b71af13439813f00ab0. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:37:52.016884 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-92c901be-e58e-4616-a48e-483aaea768fa tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.444015 Sep 06 04:37:52.017727 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 132/291] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Sep 6 04:37:51 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:37:52.598925 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-17445845-2cd0-4f01-bb92-3cb68e2be424 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:52.600436 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-17445845-2cd0-4f01-bb92-3cb68e2be424 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:52.607759 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17445845-2cd0-4f01-bb92-3cb68e2be424 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:52.608241 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17445845-2cd0-4f01-bb92-3cb68e2be424 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:52.608664 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17445845-2cd0-4f01-bb92-3cb68e2be424 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:52.609623 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17445845-2cd0-4f01-bb92-3cb68e2be424 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:52.610287 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17445845-2cd0-4f01-bb92-3cb68e2be424 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:52.610931 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-17445845-2cd0-4f01-bb92-3cb68e2be424 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:52.794265 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-17445845-2cd0-4f01-bb92-3cb68e2be424 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:52.806194 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-17445845-2cd0-4f01-bb92-3cb68e2be424 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.213816 Sep 06 04:37:52.806970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 160/292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:52 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:53.834841 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dfd59c8f-ba56-4fd6-bdd9-ea73f4b0a510 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:53.835676 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dfd59c8f-ba56-4fd6-bdd9-ea73f4b0a510 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:53.865199 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfd59c8f-ba56-4fd6-bdd9-ea73f4b0a510 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:53.865770 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfd59c8f-ba56-4fd6-bdd9-ea73f4b0a510 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:53.868134 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfd59c8f-ba56-4fd6-bdd9-ea73f4b0a510 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:53.868941 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfd59c8f-ba56-4fd6-bdd9-ea73f4b0a510 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:53.869608 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfd59c8f-ba56-4fd6-bdd9-ea73f4b0a510 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:53.870547 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dfd59c8f-ba56-4fd6-bdd9-ea73f4b0a510 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:54.075117 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dfd59c8f-ba56-4fd6-bdd9-ea73f4b0a510 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:54.087981 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dfd59c8f-ba56-4fd6-bdd9-ea73f4b0a510 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.260286 Sep 06 04:37:54.088452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 133/293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:53 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:55.113172 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3e9a78d7-61df-4004-836a-37d0f99bf450 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:55.114811 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3e9a78d7-61df-4004-836a-37d0f99bf450 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:55.122959 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e9a78d7-61df-4004-836a-37d0f99bf450 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:55.123947 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e9a78d7-61df-4004-836a-37d0f99bf450 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:55.124731 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e9a78d7-61df-4004-836a-37d0f99bf450 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:55.125683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e9a78d7-61df-4004-836a-37d0f99bf450 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:55.126289 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e9a78d7-61df-4004-836a-37d0f99bf450 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:55.126915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e9a78d7-61df-4004-836a-37d0f99bf450 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:55.320662 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3e9a78d7-61df-4004-836a-37d0f99bf450 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:55.330730 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3e9a78d7-61df-4004-836a-37d0f99bf450 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1500 microversion: 2.1 time: 0.221975 Sep 06 04:37:55.331860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 161/294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:55 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1500 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:55.358852 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-087e2842-0a42-47c0-aae1-b52de2981c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94e0502a-0e5a-498e-8627-8cf355be65d1"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:37:55.361627 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-087e2842-0a42-47c0-aae1-b52de2981c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:55.372353 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-087e2842-0a42-47c0-aae1-b52de2981c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:55.372843 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-087e2842-0a42-47c0-aae1-b52de2981c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:55.379127 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-087e2842-0a42-47c0-aae1-b52de2981c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:55.380031 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-087e2842-0a42-47c0-aae1-b52de2981c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:55.380627 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-087e2842-0a42-47c0-aae1-b52de2981c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:55.381156 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-087e2842-0a42-47c0-aae1-b52de2981c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:55.448484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-087e2842-0a42-47c0-aae1-b52de2981c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] HTTP exception thrown: Cannot 'attach_volume' instance ed927594-12ef-48af-b170-5b88f8ecb0ec while it is in vm_state rescued Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-087e2842-0a42-47c0-aae1-b52de2981c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Request method failure captured: Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: POST /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec/os-volume_attachments HTTP/1.1 Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 74 Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4ShSrtmqUjFGUKG962wNt7LkzYM3H0fxdZ4mdnzTKicnH2a1pwDbv7dv5CWGNDm2D2-tqaRREzJYjQqF33RYhMiNEgLbULGTL6P0__4bHirkaw0M3xA0fCopVUzt_zEi1at48QcuQnfkdAMrCCuCfH2J4_6gox-co2Z-Cq2ue1hT0 Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 7aa4ca550edd4876a4c6c56deedf9d70 Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1362344250 Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:37:55.450124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:37:55.454908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:37:55.454908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1362344250 Sep 06 04:37:55.454908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 7aa4ca550edd4876a4c6c56deedf9d70 Sep 06 04:37:55.454908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1362344250 Sep 06 04:37:55.454908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-ServerRescueNegativeTestJSON-1362344250-project Sep 06 04:37:55.454908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:37:55.454908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:37:55.454908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: dec1c17550b849dbadbc16e98530b455 Sep 06 04:37:55.454908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1362344250-project Sep 06 04:37:55.454908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Sep 06 04:37:55.454908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {"volumeAttachment": {"volumeId": "94e0502a-0e5a-498e-8627-8cf355be65d1"}} Sep 06 04:37:55.454908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Cannot 'attach_volume' instance ed927594-12ef-48af-b170-5b88f8ecb0ec while it is in vm_state rescued Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'server_id': 'ed927594-12ef-48af-b170-5b88f8ecb0ec', 'body': {'volumeAttachment': {'volumeId': '94e0502a-0e5a-498e-8627-8cf355be65d1'}}} Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ed927594-12ef-48af-b170-5b88f8ecb0ec in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:37:55.455650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ed927594-12ef-48af-b170-5b88f8ecb0ec while it is in vm_state rescued Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:37:55.457574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:37:55.460218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:37:55.460218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:37:55.460218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ed927594-12ef-48af-b170-5b88f8ecb0ec while it is in vm_state rescued Sep 06 04:37:55.460218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:37:55.460218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-087e2842-0a42-47c0-aae1-b52de2981c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Returning 409 to user: Cannot 'attach_volume' instance ed927594-12ef-48af-b170-5b88f8ecb0ec while it is in vm_state rescued {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:37:55.460218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-087e2842-0a42-47c0-aae1-b52de2981c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "POST /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.098202 Sep 06 04:37:55.460218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 134/295] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Sep 6 04:37:55 2022] POST /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec/os-volume_attachments => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 04:37:55.468764 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3b4edc53-20e3-4444-a048-76605848c1bb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:37:55.469654 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3b4edc53-20e3-4444-a048-76605848c1bb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:55.477466 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b4edc53-20e3-4444-a048-76605848c1bb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:55.478220 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b4edc53-20e3-4444-a048-76605848c1bb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:55.479150 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b4edc53-20e3-4444-a048-76605848c1bb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:55.496101 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b4edc53-20e3-4444-a048-76605848c1bb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:55.496878 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b4edc53-20e3-4444-a048-76605848c1bb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:55.498633 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b4edc53-20e3-4444-a048-76605848c1bb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:55.817048 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3b4edc53-20e3-4444-a048-76605848c1bb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "POST /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec/action" status: 202 len: 0 microversion: 2.1 time: 0.354211 Sep 06 04:37:55.817719 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 162/296] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Sep 6 04:37:55 2022] POST /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec/action => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:37:55.827546 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b1009aff-e851-412d-95b9-1ceace0d0812 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:55.828163 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b1009aff-e851-412d-95b9-1ceace0d0812 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:55.850445 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1009aff-e851-412d-95b9-1ceace0d0812 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:55.850945 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1009aff-e851-412d-95b9-1ceace0d0812 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:55.851380 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1009aff-e851-412d-95b9-1ceace0d0812 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:55.852084 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1009aff-e851-412d-95b9-1ceace0d0812 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:55.852557 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1009aff-e851-412d-95b9-1ceace0d0812 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:55.852978 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1009aff-e851-412d-95b9-1ceace0d0812 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:56.055092 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b1009aff-e851-412d-95b9-1ceace0d0812 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:56.065648 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b1009aff-e851-412d-95b9-1ceace0d0812 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1508 microversion: 2.1 time: 0.243444 Sep 06 04:37:56.066930 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 135/297] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:55 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1508 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:57.097611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fddf89ca-5066-433e-8375-9d44d9221402 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:57.098329 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fddf89ca-5066-433e-8375-9d44d9221402 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:57.126752 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fddf89ca-5066-433e-8375-9d44d9221402 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:57.127642 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fddf89ca-5066-433e-8375-9d44d9221402 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:57.128422 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fddf89ca-5066-433e-8375-9d44d9221402 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:57.129373 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fddf89ca-5066-433e-8375-9d44d9221402 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:57.131133 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fddf89ca-5066-433e-8375-9d44d9221402 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:57.133584 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fddf89ca-5066-433e-8375-9d44d9221402 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:57.164656 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:37:57.377850 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fddf89ca-5066-433e-8375-9d44d9221402 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:57.392207 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fddf89ca-5066-433e-8375-9d44d9221402 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1508 microversion: 2.1 time: 0.302999 Sep 06 04:37:57.392806 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 163/298] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:57 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1508 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:58.421209 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eeb7169d-4036-4a54-8c84-78d66a148d70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:58.421844 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-eeb7169d-4036-4a54-8c84-78d66a148d70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:58.429516 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeb7169d-4036-4a54-8c84-78d66a148d70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:58.432948 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeb7169d-4036-4a54-8c84-78d66a148d70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:58.433412 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeb7169d-4036-4a54-8c84-78d66a148d70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:58.434144 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeb7169d-4036-4a54-8c84-78d66a148d70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:58.438759 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeb7169d-4036-4a54-8c84-78d66a148d70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:58.438759 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeb7169d-4036-4a54-8c84-78d66a148d70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:58.582842 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eeb7169d-4036-4a54-8c84-78d66a148d70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:58.590973 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-eeb7169d-4036-4a54-8c84-78d66a148d70 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1508 microversion: 2.1 time: 0.174624 Sep 06 04:37:58.605897 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 136/299] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:58 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:37:59.622453 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dcfb4c89-5a53-4770-bb7f-cf08d673f4cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:37:59.623827 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dcfb4c89-5a53-4770-bb7f-cf08d673f4cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:37:59.642520 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcfb4c89-5a53-4770-bb7f-cf08d673f4cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:59.643422 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcfb4c89-5a53-4770-bb7f-cf08d673f4cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:59.643851 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcfb4c89-5a53-4770-bb7f-cf08d673f4cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:59.644885 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcfb4c89-5a53-4770-bb7f-cf08d673f4cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:37:59.645636 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcfb4c89-5a53-4770-bb7f-cf08d673f4cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:37:59.646302 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcfb4c89-5a53-4770-bb7f-cf08d673f4cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:37:59.843090 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-dcfb4c89-5a53-4770-bb7f-cf08d673f4cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:37:59.854014 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dcfb4c89-5a53-4770-bb7f-cf08d673f4cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1508 microversion: 2.1 time: 0.239643 Sep 06 04:37:59.855452 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 164/300] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:37:59 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:00.879884 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-348c93d1-2690-4b89-baac-7dbda478e1d4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:00.880492 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-348c93d1-2690-4b89-baac-7dbda478e1d4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:00.888092 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-348c93d1-2690-4b89-baac-7dbda478e1d4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:00.888788 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-348c93d1-2690-4b89-baac-7dbda478e1d4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:00.889440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-348c93d1-2690-4b89-baac-7dbda478e1d4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:00.890131 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-348c93d1-2690-4b89-baac-7dbda478e1d4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:00.890582 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-348c93d1-2690-4b89-baac-7dbda478e1d4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:00.890987 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-348c93d1-2690-4b89-baac-7dbda478e1d4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:01.049714 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-348c93d1-2690-4b89-baac-7dbda478e1d4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:01.058076 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-348c93d1-2690-4b89-baac-7dbda478e1d4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1514 microversion: 2.1 time: 0.182267 Sep 06 04:38:01.058654 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 137/301] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:00 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:03.412278 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4ead8a76-5e13-4695-892f-194c915547a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Action: 'create', calling method: .version_select at 0x7f31766b8430>, body: {"keypair": {"name": "tempest-keypair-2089788396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOISPzJUTWanrMyB63qkfyN7WSXkX3OXzxjxcdmo784teVSnVUlf3jq2sq/YzMDTnrthM67QpYE8puSpzaWeywbjkq9me6gkwTgycCnE9hZNowLZfWe8hTYozvCEGDGfRQ=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:38:03.418712 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=31 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:03.438136 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-4ead8a76-5e13-4695-892f-194c915547a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Getting quotas for project 7aa4ca550edd4876a4c6c56deedf9d70. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:38:03.442848 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-4ead8a76-5e13-4695-892f-194c915547a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Getting quotas for user dec1c17550b849dbadbc16e98530b455 and project 7aa4ca550edd4876a4c6c56deedf9d70. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:38:03.562882 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4ead8a76-5e13-4695-892f-194c915547a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.154341 Sep 06 04:38:03.563799 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 165/302] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Sep 6 04:38:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:38:05.805847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-689793122", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06e43195-6270-4b08-b3f6-284307ad52d8"}], "security_groups": [{"name": "tempest-securitygroup--896333821"}], "key_name": "tempest-keypair-2089788396", "user_data": "}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:38:05.816386 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:05.817327 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:05.916295 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] validate_networks() for [('06e43195-6270-4b08-b3f6-284307ad52d8', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:38:06.317142 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:38:06.317997 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:38:06.318651 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:38:06.319309 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:38:06.320040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:38:06.331459 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:06.332085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:06.332521 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:06.333247 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:06.336137 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:06.337370 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:06.350794 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=65 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:06.365336 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Getting quotas for project 7aa4ca550edd4876a4c6c56deedf9d70. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:38:06.374899 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Getting quotas for user dec1c17550b849dbadbc16e98530b455 and project 7aa4ca550edd4876a4c6c56deedf9d70. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:38:06.396826 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:38:06.399369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:38:06.535984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a6c12e78-237b-4cdf-90ed-cf955c21e92e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.736777 Sep 06 04:38:06.536567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 138/303] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:38:05 2022] POST /compute/v2.1/servers => generated 408 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:38:06.549616 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e2e7a6a1-7e53-4a6d-bfc5-553afb8a7e5b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:06.551105 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e2e7a6a1-7e53-4a6d-bfc5-553afb8a7e5b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:06.607574 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e2e7a6a1-7e53-4a6d-bfc5-553afb8a7e5b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:06.614657 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e2e7a6a1-7e53-4a6d-bfc5-553afb8a7e5b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1245 microversion: 2.1 time: 0.069913 Sep 06 04:38:06.615565 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 166/304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:06 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1245 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:07.646838 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ca0a410f-be36-4568-83ef-9e8d1637178d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:07.647449 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ca0a410f-be36-4568-83ef-9e8d1637178d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:07.655824 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca0a410f-be36-4568-83ef-9e8d1637178d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:07.656328 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca0a410f-be36-4568-83ef-9e8d1637178d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:07.656750 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca0a410f-be36-4568-83ef-9e8d1637178d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:07.657470 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca0a410f-be36-4568-83ef-9e8d1637178d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:07.657925 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca0a410f-be36-4568-83ef-9e8d1637178d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:07.658348 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca0a410f-be36-4568-83ef-9e8d1637178d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:07.727458 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ca0a410f-be36-4568-83ef-9e8d1637178d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:07.735379 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ca0a410f-be36-4568-83ef-9e8d1637178d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1249 microversion: 2.1 time: 0.092792 Sep 06 04:38:07.735950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 139/305] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:07 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1249 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:08.758925 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-333f0df0-37b3-4163-b3b2-ca84f5a676f3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:08.759466 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-333f0df0-37b3-4163-b3b2-ca84f5a676f3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:08.769407 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-333f0df0-37b3-4163-b3b2-ca84f5a676f3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:08.770031 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-333f0df0-37b3-4163-b3b2-ca84f5a676f3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:08.770605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-333f0df0-37b3-4163-b3b2-ca84f5a676f3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:08.771409 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-333f0df0-37b3-4163-b3b2-ca84f5a676f3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:08.771965 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-333f0df0-37b3-4163-b3b2-ca84f5a676f3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:08.772493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-333f0df0-37b3-4163-b3b2-ca84f5a676f3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:08.848685 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-333f0df0-37b3-4163-b3b2-ca84f5a676f3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:08.860209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-333f0df0-37b3-4163-b3b2-ca84f5a676f3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1305 microversion: 2.1 time: 0.105061 Sep 06 04:38:08.861171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 167/306] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:08 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1305 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:09.884622 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2d388018-875e-46a3-957b-269f216be80b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:09.886149 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2d388018-875e-46a3-957b-269f216be80b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:09.894854 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2d388018-875e-46a3-957b-269f216be80b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:09.895403 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2d388018-875e-46a3-957b-269f216be80b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:09.895885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2d388018-875e-46a3-957b-269f216be80b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:09.896545 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2d388018-875e-46a3-957b-269f216be80b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:09.897103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2d388018-875e-46a3-957b-269f216be80b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:09.897725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2d388018-875e-46a3-957b-269f216be80b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:10.106102 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2d388018-875e-46a3-957b-269f216be80b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:10.116425 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2d388018-875e-46a3-957b-269f216be80b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1370 microversion: 2.1 time: 0.235732 Sep 06 04:38:10.116626 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 140/307] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:09 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:10.953496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-0f48717a-4879-453c-be5b-717dbe5b360a req-70129e16-f5dc-4c1a-9a47-29f873ab1414 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4631439d-ba1a-4895-88bc-66f83e93defa", "tag": "6c3db147-6601-4ab0-a362-ff2c28ef3252"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:38:10.969573 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-0f48717a-4879-453c-be5b-717dbe5b360a req-70129e16-f5dc-4c1a-9a47-29f873ab1414 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:10.970448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-0f48717a-4879-453c-be5b-717dbe5b360a req-70129e16-f5dc-4c1a-9a47-29f873ab1414 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:10.971055 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-0f48717a-4879-453c-be5b-717dbe5b360a req-70129e16-f5dc-4c1a-9a47-29f873ab1414 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:10.986132 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-0f48717a-4879-453c-be5b-717dbe5b360a req-70129e16-f5dc-4c1a-9a47-29f873ab1414 service nova] Creating event network-changed:6c3db147-6601-4ab0-a362-ff2c28ef3252 for instance 4631439d-ba1a-4895-88bc-66f83e93defa on hv-cinder-85600 Sep 06 04:38:10.992667 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-0f48717a-4879-453c-be5b-717dbe5b360a req-70129e16-f5dc-4c1a-9a47-29f873ab1414 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048380 Sep 06 04:38:10.995740 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 168/308] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:38:11.142383 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7fcd95de-54bc-41fe-b37b-97783201f3fb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:11.143509 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7fcd95de-54bc-41fe-b37b-97783201f3fb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:11.153022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7fcd95de-54bc-41fe-b37b-97783201f3fb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:11.153905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7fcd95de-54bc-41fe-b37b-97783201f3fb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:11.154340 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7fcd95de-54bc-41fe-b37b-97783201f3fb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:11.155033 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7fcd95de-54bc-41fe-b37b-97783201f3fb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:11.155485 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7fcd95de-54bc-41fe-b37b-97783201f3fb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:11.155903 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7fcd95de-54bc-41fe-b37b-97783201f3fb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:11.414346 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7fcd95de-54bc-41fe-b37b-97783201f3fb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:11.423815 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7fcd95de-54bc-41fe-b37b-97783201f3fb tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1370 microversion: 2.1 time: 0.286595 Sep 06 04:38:11.424406 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 141/309] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:11 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1370 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:12.451689 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c366966a-59aa-4073-a5eb-13ec90045682 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:12.452408 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c366966a-59aa-4073-a5eb-13ec90045682 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:12.458803 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c366966a-59aa-4073-a5eb-13ec90045682 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:12.459288 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c366966a-59aa-4073-a5eb-13ec90045682 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:12.460270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c366966a-59aa-4073-a5eb-13ec90045682 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:12.461084 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c366966a-59aa-4073-a5eb-13ec90045682 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:12.461679 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c366966a-59aa-4073-a5eb-13ec90045682 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:12.462133 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c366966a-59aa-4073-a5eb-13ec90045682 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:12.792760 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c366966a-59aa-4073-a5eb-13ec90045682 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:12.800553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c366966a-59aa-4073-a5eb-13ec90045682 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1370 microversion: 2.1 time: 0.353791 Sep 06 04:38:12.801129 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 169/310] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:12 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1370 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:13.823788 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3a566cf7-fe08-4ecf-897e-c896091e0c5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:13.825012 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3a566cf7-fe08-4ecf-897e-c896091e0c5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:13.831375 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a566cf7-fe08-4ecf-897e-c896091e0c5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:13.831928 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a566cf7-fe08-4ecf-897e-c896091e0c5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:13.832360 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a566cf7-fe08-4ecf-897e-c896091e0c5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:13.833045 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a566cf7-fe08-4ecf-897e-c896091e0c5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:13.833522 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a566cf7-fe08-4ecf-897e-c896091e0c5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:13.833937 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a566cf7-fe08-4ecf-897e-c896091e0c5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:13.986668 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3a566cf7-fe08-4ecf-897e-c896091e0c5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:13.994552 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3a566cf7-fe08-4ecf-897e-c896091e0c5c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1370 microversion: 2.1 time: 0.174541 Sep 06 04:38:13.995477 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 142/311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:13 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:15.022148 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2add5d5d-ecd4-4048-acd3-c6e4127d329e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:15.023528 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2add5d5d-ecd4-4048-acd3-c6e4127d329e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:15.036418 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2add5d5d-ecd4-4048-acd3-c6e4127d329e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:15.037225 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2add5d5d-ecd4-4048-acd3-c6e4127d329e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:15.037787 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2add5d5d-ecd4-4048-acd3-c6e4127d329e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:15.038711 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2add5d5d-ecd4-4048-acd3-c6e4127d329e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:15.039423 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2add5d5d-ecd4-4048-acd3-c6e4127d329e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:15.040078 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2add5d5d-ecd4-4048-acd3-c6e4127d329e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:15.189641 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2add5d5d-ecd4-4048-acd3-c6e4127d329e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:15.197508 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2add5d5d-ecd4-4048-acd3-c6e4127d329e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1370 microversion: 2.1 time: 0.181191 Sep 06 04:38:15.200361 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 170/312] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:15 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:16.223843 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5a9daeea-835e-463c-bbdd-0e963eca482b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:16.224545 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5a9daeea-835e-463c-bbdd-0e963eca482b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:16.231574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5a9daeea-835e-463c-bbdd-0e963eca482b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:16.233043 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5a9daeea-835e-463c-bbdd-0e963eca482b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:16.234134 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5a9daeea-835e-463c-bbdd-0e963eca482b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:16.234956 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5a9daeea-835e-463c-bbdd-0e963eca482b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:16.235549 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5a9daeea-835e-463c-bbdd-0e963eca482b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:16.236618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5a9daeea-835e-463c-bbdd-0e963eca482b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:16.351762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:16.390985 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:16.433938 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5a9daeea-835e-463c-bbdd-0e963eca482b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:16.442468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5a9daeea-835e-463c-bbdd-0e963eca482b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1370 microversion: 2.1 time: 0.223270 Sep 06 04:38:16.443043 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 143/313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:16 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:17.466229 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b75696db-1345-4e19-92e3-a20eea40a7a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:17.466824 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b75696db-1345-4e19-92e3-a20eea40a7a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:17.468734 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:17.473924 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b75696db-1345-4e19-92e3-a20eea40a7a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:17.474415 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b75696db-1345-4e19-92e3-a20eea40a7a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:17.474851 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b75696db-1345-4e19-92e3-a20eea40a7a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:17.475571 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b75696db-1345-4e19-92e3-a20eea40a7a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:17.476027 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b75696db-1345-4e19-92e3-a20eea40a7a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:17.476453 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b75696db-1345-4e19-92e3-a20eea40a7a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:17.611001 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b75696db-1345-4e19-92e3-a20eea40a7a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:17.620947 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b75696db-1345-4e19-92e3-a20eea40a7a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1370 microversion: 2.1 time: 0.158103 Sep 06 04:38:17.628349 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 171/314] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:17 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:18.645052 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0377abe3-cec5-471e-a1ec-134eccc0e2d9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:18.646285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0377abe3-cec5-471e-a1ec-134eccc0e2d9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:18.653698 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0377abe3-cec5-471e-a1ec-134eccc0e2d9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:18.654535 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0377abe3-cec5-471e-a1ec-134eccc0e2d9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:18.654967 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0377abe3-cec5-471e-a1ec-134eccc0e2d9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:18.655859 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0377abe3-cec5-471e-a1ec-134eccc0e2d9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:18.656314 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0377abe3-cec5-471e-a1ec-134eccc0e2d9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:18.657507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0377abe3-cec5-471e-a1ec-134eccc0e2d9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:18.819937 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0377abe3-cec5-471e-a1ec-134eccc0e2d9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:18.828424 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0377abe3-cec5-471e-a1ec-134eccc0e2d9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1370 microversion: 2.1 time: 0.188196 Sep 06 04:38:18.828945 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 144/315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:18 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:19.120094 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-a02bcd98-8fca-46c9-b12a-9328ff427921 req-c581ee9e-eb95-4772-9657-0ba17a6f2b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4631439d-ba1a-4895-88bc-66f83e93defa", "name": "network-vif-plugged", "status": "completed", "tag": "6c3db147-6601-4ab0-a362-ff2c28ef3252"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:38:19.129451 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-a02bcd98-8fca-46c9-b12a-9328ff427921 req-c581ee9e-eb95-4772-9657-0ba17a6f2b5d service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:19.129920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-a02bcd98-8fca-46c9-b12a-9328ff427921 req-c581ee9e-eb95-4772-9657-0ba17a6f2b5d service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:19.130340 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-a02bcd98-8fca-46c9-b12a-9328ff427921 req-c581ee9e-eb95-4772-9657-0ba17a6f2b5d service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:19.143646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-a02bcd98-8fca-46c9-b12a-9328ff427921 req-c581ee9e-eb95-4772-9657-0ba17a6f2b5d service nova] Creating event network-vif-plugged:6c3db147-6601-4ab0-a362-ff2c28ef3252 for instance 4631439d-ba1a-4895-88bc-66f83e93defa on hv-cinder-85600 Sep 06 04:38:19.148667 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-a02bcd98-8fca-46c9-b12a-9328ff427921 req-c581ee9e-eb95-4772-9657-0ba17a6f2b5d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035303 Sep 06 04:38:19.149246 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 172/316] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:38:19.852576 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-aae418f5-bbbe-462a-8c5f-ef11e0a6ce4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:19.853172 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-aae418f5-bbbe-462a-8c5f-ef11e0a6ce4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:19.860381 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aae418f5-bbbe-462a-8c5f-ef11e0a6ce4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:19.868006 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aae418f5-bbbe-462a-8c5f-ef11e0a6ce4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:19.868006 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aae418f5-bbbe-462a-8c5f-ef11e0a6ce4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:19.868006 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aae418f5-bbbe-462a-8c5f-ef11e0a6ce4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:19.868006 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aae418f5-bbbe-462a-8c5f-ef11e0a6ce4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:19.868361 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aae418f5-bbbe-462a-8c5f-ef11e0a6ce4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:20.012865 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-aae418f5-bbbe-462a-8c5f-ef11e0a6ce4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:20.021954 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-aae418f5-bbbe-462a-8c5f-ef11e0a6ce4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1370 microversion: 2.1 time: 0.173291 Sep 06 04:38:20.022523 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 145/317] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:19 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:21.046242 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0a3cab30-103c-41f1-b094-e92c795575cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:21.046954 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0a3cab30-103c-41f1-b094-e92c795575cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:21.053060 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0a3cab30-103c-41f1-b094-e92c795575cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:21.053569 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0a3cab30-103c-41f1-b094-e92c795575cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:21.053998 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0a3cab30-103c-41f1-b094-e92c795575cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:21.054678 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0a3cab30-103c-41f1-b094-e92c795575cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:21.055124 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0a3cab30-103c-41f1-b094-e92c795575cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:21.055536 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0a3cab30-103c-41f1-b094-e92c795575cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:21.186742 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0a3cab30-103c-41f1-b094-e92c795575cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:21.194558 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0a3cab30-103c-41f1-b094-e92c795575cc tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1370 microversion: 2.1 time: 0.152451 Sep 06 04:38:21.195117 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 173/318] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:21 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:22.218242 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5189ad6e-14c5-42fb-84d5-85d4462ded89 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:22.218848 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5189ad6e-14c5-42fb-84d5-85d4462ded89 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:22.225838 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5189ad6e-14c5-42fb-84d5-85d4462ded89 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:22.226320 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5189ad6e-14c5-42fb-84d5-85d4462ded89 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:22.226756 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5189ad6e-14c5-42fb-84d5-85d4462ded89 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:22.227443 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5189ad6e-14c5-42fb-84d5-85d4462ded89 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:22.227898 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5189ad6e-14c5-42fb-84d5-85d4462ded89 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:22.228319 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5189ad6e-14c5-42fb-84d5-85d4462ded89 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:22.358499 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5189ad6e-14c5-42fb-84d5-85d4462ded89 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:22.379461 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5189ad6e-14c5-42fb-84d5-85d4462ded89 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1564 microversion: 2.1 time: 0.165038 Sep 06 04:38:22.401474 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 146/319] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:22 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1564 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:22.407394 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f1f49797-a1b0-4ed6-aea1-3f45ca037a4e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:22.407867 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f1f49797-a1b0-4ed6-aea1-3f45ca037a4e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:22.415573 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1f49797-a1b0-4ed6-aea1-3f45ca037a4e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:22.416098 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1f49797-a1b0-4ed6-aea1-3f45ca037a4e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:22.416576 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1f49797-a1b0-4ed6-aea1-3f45ca037a4e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:22.417342 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1f49797-a1b0-4ed6-aea1-3f45ca037a4e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:22.417857 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1f49797-a1b0-4ed6-aea1-3f45ca037a4e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:22.418230 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f1f49797-a1b0-4ed6-aea1-3f45ca037a4e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:22.735661 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f1f49797-a1b0-4ed6-aea1-3f45ca037a4e tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095566 Sep 06 04:38:22.735661 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 174/320] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Sep 6 04:38:22 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:38:22.736029 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-795733776", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "networks": [{"uuid": "4fde5cd2-7805-4052-b982-e07ad789f60a"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:38:22.793552 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] validate_networks() for [('4fde5cd2-7805-4052-b982-e07ad789f60a', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:38:23.225694 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:38:23.226776 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:38:23.227420 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:38:23.227840 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:38:23.228253 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:38:23.241360 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:23.242331 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:23.243014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:23.244150 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:23.244858 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:23.245513 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:23.266681 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Getting quotas for project 36495849f5124872ba74fe21b00f72fe. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:38:23.269560 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Getting quotas for user 784815b8c6d0400c92caa54981b137d9 and project 36495849f5124872ba74fe21b00f72fe. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:38:23.287812 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:38:23.290163 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:38:23.330022 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-921986535", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-153806682", "security_groups": [{"name": "tempest-secgroup-smoke-1357749998"}], "block_device_mapping_v2": [{"uuid": "019e728a-be1a-45d3-a8be-0e03476714e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "713bea32-eeee-4105-a352-3326771fb659"}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:38:23.452962 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-164991ed-7d57-430c-853b-f5f99b81256f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720941 Sep 06 04:38:23.461212 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 147/321] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:38:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:38:23.473024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b0d46ac1-b4b9-46f1-a377-78013f8dbf2c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:23.473024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b0d46ac1-b4b9-46f1-a377-78013f8dbf2c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:23.616411 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b0d46ac1-b4b9-46f1-a377-78013f8dbf2c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:23.624031 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b0d46ac1-b4b9-46f1-a377-78013f8dbf2c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1218 microversion: 2.1 time: 0.161348 Sep 06 04:38:23.624613 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 148/322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:23 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1218 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:23.633537 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] validate_networks() for [('713bea32-eeee-4105-a352-3326771fb659', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:38:24.483235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-3f3eff62-9515-4671-887e-a6909e5e6411 req-83d331db-88a7-4f01-a882-bb9fd4926a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4631439d-ba1a-4895-88bc-66f83e93defa", "tag": "6c3db147-6601-4ab0-a362-ff2c28ef3252"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:38:24.504691 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-3f3eff62-9515-4671-887e-a6909e5e6411 req-83d331db-88a7-4f01-a882-bb9fd4926a4e service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:24.505179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-3f3eff62-9515-4671-887e-a6909e5e6411 req-83d331db-88a7-4f01-a882-bb9fd4926a4e service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:24.505652 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-3f3eff62-9515-4671-887e-a6909e5e6411 req-83d331db-88a7-4f01-a882-bb9fd4926a4e service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:24.518501 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-3f3eff62-9515-4671-887e-a6909e5e6411 req-83d331db-88a7-4f01-a882-bb9fd4926a4e service nova] Creating event network-changed:6c3db147-6601-4ab0-a362-ff2c28ef3252 for instance 4631439d-ba1a-4895-88bc-66f83e93defa on hv-cinder-85600 Sep 06 04:38:24.524087 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-3f3eff62-9515-4671-887e-a6909e5e6411 req-83d331db-88a7-4f01-a882-bb9fd4926a4e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044348 Sep 06 04:38:24.525168 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 149/323] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:38:24.540375 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:38:24.541135 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:38:24.541838 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:38:24.542406 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:38:24.545618 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:38:24.559001 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:24.560179 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:24.560948 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:24.562013 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:24.562674 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:24.563265 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:24.590124 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Getting quotas for project 375efd2890fc4b71af13439813f00ab0. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:38:24.594273 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Getting quotas for user 4b6c761af9c5457ea1e481ce400aded8 and project 375efd2890fc4b71af13439813f00ab0. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:38:24.648699 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7095074e-0e20-40d4-8011-b00a04d849d8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:24.649702 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7095074e-0e20-40d4-8011-b00a04d849d8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:24.656560 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7095074e-0e20-40d4-8011-b00a04d849d8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:24.657340 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7095074e-0e20-40d4-8011-b00a04d849d8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:24.657998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7095074e-0e20-40d4-8011-b00a04d849d8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:24.659782 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7095074e-0e20-40d4-8011-b00a04d849d8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:24.660445 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7095074e-0e20-40d4-8011-b00a04d849d8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:24.661818 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7095074e-0e20-40d4-8011-b00a04d849d8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:24.670143 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:38:24.673474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='019e728a-be1a-45d3-a8be-0e03476714e4',volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:38:24.789196 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7095074e-0e20-40d4-8011-b00a04d849d8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:24.797368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7095074e-0e20-40d4-8011-b00a04d849d8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1222 microversion: 2.1 time: 0.153083 Sep 06 04:38:24.798999 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 150/324] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:24 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1222 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:38:25.185994 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5d06b59b-2b72-4c67-9d2d-4e0ce1f9cb14 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.860363 Sep 06 04:38:25.191691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 175/325] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:38:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 04:38:25.203088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-20566113-1b72-410f-8686-76dd78dab173 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:25.204755 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-20566113-1b72-410f-8686-76dd78dab173 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:25.277657 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-20566113-1b72-410f-8686-76dd78dab173 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:25.286857 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-20566113-1b72-410f-8686-76dd78dab173 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1093 microversion: 2.1 time: 0.087593 Sep 06 04:38:25.288056 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 151/326] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:25 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1093 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:25.821075 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-edd165cb-3f4c-4dbb-b040-9d4a5e965444 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:25.821941 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-edd165cb-3f4c-4dbb-b040-9d4a5e965444 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:25.839114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edd165cb-3f4c-4dbb-b040-9d4a5e965444 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:25.839114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edd165cb-3f4c-4dbb-b040-9d4a5e965444 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:25.839114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edd165cb-3f4c-4dbb-b040-9d4a5e965444 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:25.841938 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edd165cb-3f4c-4dbb-b040-9d4a5e965444 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:25.843109 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edd165cb-3f4c-4dbb-b040-9d4a5e965444 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:25.843749 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-edd165cb-3f4c-4dbb-b040-9d4a5e965444 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:25.987935 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-edd165cb-3f4c-4dbb-b040-9d4a5e965444 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:25.992762 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-edd165cb-3f4c-4dbb-b040-9d4a5e965444 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1270 microversion: 2.1 time: 0.175638 Sep 06 04:38:25.993390 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 176/327] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:25 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1270 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:38:26.311871 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-10b999f3-0d27-40af-8ab2-9d6f4b899039 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:26.312488 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-10b999f3-0d27-40af-8ab2-9d6f4b899039 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:26.410274 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-10b999f3-0d27-40af-8ab2-9d6f4b899039 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:26.418396 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-10b999f3-0d27-40af-8ab2-9d6f4b899039 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1093 microversion: 2.1 time: 0.110933 Sep 06 04:38:26.420315 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 152/328] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:26 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1093 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:27.022313 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a2acba2c-3aee-4643-826a-9781644f7bbc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:27.022913 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a2acba2c-3aee-4643-826a-9781644f7bbc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:27.030438 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2acba2c-3aee-4643-826a-9781644f7bbc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:27.030942 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2acba2c-3aee-4643-826a-9781644f7bbc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:27.031379 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2acba2c-3aee-4643-826a-9781644f7bbc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:27.032307 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2acba2c-3aee-4643-826a-9781644f7bbc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:27.032759 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2acba2c-3aee-4643-826a-9781644f7bbc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:27.033373 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2acba2c-3aee-4643-826a-9781644f7bbc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:27.110337 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a2acba2c-3aee-4643-826a-9781644f7bbc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:27.131920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a2acba2c-3aee-4643-826a-9781644f7bbc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1276 microversion: 2.1 time: 0.113739 Sep 06 04:38:27.146402 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 177/329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:27 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1276 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:27.442874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3175aa6a-d274-43fc-b3c5-2088c5abe98e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:27.443504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3175aa6a-d274-43fc-b3c5-2088c5abe98e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:27.462260 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3175aa6a-d274-43fc-b3c5-2088c5abe98e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:27.462950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3175aa6a-d274-43fc-b3c5-2088c5abe98e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:27.463634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3175aa6a-d274-43fc-b3c5-2088c5abe98e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:27.466451 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3175aa6a-d274-43fc-b3c5-2088c5abe98e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:27.467148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3175aa6a-d274-43fc-b3c5-2088c5abe98e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:27.467767 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3175aa6a-d274-43fc-b3c5-2088c5abe98e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:27.660665 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3175aa6a-d274-43fc-b3c5-2088c5abe98e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:27.680868 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3175aa6a-d274-43fc-b3c5-2088c5abe98e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1191 microversion: 2.1 time: 0.240109 Sep 06 04:38:27.686304 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 153/330] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:27 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1191 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:28.159411 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8d531ab7-2d94-4e8c-aeb1-95e43994aa08 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:28.159411 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8d531ab7-2d94-4e8c-aeb1-95e43994aa08 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:28.166786 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d531ab7-2d94-4e8c-aeb1-95e43994aa08 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:28.167436 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d531ab7-2d94-4e8c-aeb1-95e43994aa08 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:28.168393 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d531ab7-2d94-4e8c-aeb1-95e43994aa08 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:28.169368 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d531ab7-2d94-4e8c-aeb1-95e43994aa08 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:28.169921 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d531ab7-2d94-4e8c-aeb1-95e43994aa08 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:28.170540 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d531ab7-2d94-4e8c-aeb1-95e43994aa08 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:28.495887 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-45814846-00e1-4b18-81d8-d664508414e9 req-188a4701-37b4-412e-bd6e-acce31011bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10d37307-eefc-4b31-b42d-6042e4abee25", "tag": "5f1f8c0d-db0b-4d23-89b3-a2a10a3f470f"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:38:28.512472 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-45814846-00e1-4b18-81d8-d664508414e9 req-188a4701-37b4-412e-bd6e-acce31011bb4 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:28.513761 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-45814846-00e1-4b18-81d8-d664508414e9 req-188a4701-37b4-412e-bd6e-acce31011bb4 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:28.515346 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-45814846-00e1-4b18-81d8-d664508414e9 req-188a4701-37b4-412e-bd6e-acce31011bb4 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:28.532977 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-45814846-00e1-4b18-81d8-d664508414e9 req-188a4701-37b4-412e-bd6e-acce31011bb4 service nova] Creating event network-changed:5f1f8c0d-db0b-4d23-89b3-a2a10a3f470f for instance 10d37307-eefc-4b31-b42d-6042e4abee25 on hv-cinder-85600 Sep 06 04:38:28.540195 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-45814846-00e1-4b18-81d8-d664508414e9 req-188a4701-37b4-412e-bd6e-acce31011bb4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061365 Sep 06 04:38:28.543122 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 154/331] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:38:28.708688 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8d531ab7-2d94-4e8c-aeb1-95e43994aa08 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:28.717598 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-23430ce4-87bb-4d6a-9b6b-09c374d0b0ec tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:28.718481 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-23430ce4-87bb-4d6a-9b6b-09c374d0b0ec tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:28.722908 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8d531ab7-2d94-4e8c-aeb1-95e43994aa08 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1318 microversion: 2.1 time: 0.570057 Sep 06 04:38:28.723513 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 178/332] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:28 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1318 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:28.730418 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23430ce4-87bb-4d6a-9b6b-09c374d0b0ec tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:28.731077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23430ce4-87bb-4d6a-9b6b-09c374d0b0ec tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:28.731811 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23430ce4-87bb-4d6a-9b6b-09c374d0b0ec tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:28.732602 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23430ce4-87bb-4d6a-9b6b-09c374d0b0ec tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:28.733835 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23430ce4-87bb-4d6a-9b6b-09c374d0b0ec tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:28.735824 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-23430ce4-87bb-4d6a-9b6b-09c374d0b0ec tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:29.151655 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-23430ce4-87bb-4d6a-9b6b-09c374d0b0ec tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:29.163756 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-23430ce4-87bb-4d6a-9b6b-09c374d0b0ec tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1209 microversion: 2.1 time: 0.449915 Sep 06 04:38:29.171280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 155/333] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:28 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1209 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:29.750685 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-db13459c-e566-4ae7-8c52-7df359631226 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:29.753347 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-db13459c-e566-4ae7-8c52-7df359631226 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:29.762588 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db13459c-e566-4ae7-8c52-7df359631226 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:29.769482 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db13459c-e566-4ae7-8c52-7df359631226 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:29.775171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db13459c-e566-4ae7-8c52-7df359631226 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:29.775171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db13459c-e566-4ae7-8c52-7df359631226 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:29.775171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db13459c-e566-4ae7-8c52-7df359631226 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:29.775171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db13459c-e566-4ae7-8c52-7df359631226 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:29.796131 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=67 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:30.100398 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-db13459c-e566-4ae7-8c52-7df359631226 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:30.114502 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-db13459c-e566-4ae7-8c52-7df359631226 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1318 microversion: 2.1 time: 0.364605 Sep 06 04:38:30.114502 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 179/334] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:29 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1318 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:30.188170 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-795785a7-6ab8-4f76-8940-7ddc3bb15902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:30.188875 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-795785a7-6ab8-4f76-8940-7ddc3bb15902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:30.200095 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-795785a7-6ab8-4f76-8940-7ddc3bb15902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:30.200699 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-795785a7-6ab8-4f76-8940-7ddc3bb15902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:30.201698 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-795785a7-6ab8-4f76-8940-7ddc3bb15902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:30.203683 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-795785a7-6ab8-4f76-8940-7ddc3bb15902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:30.205935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-795785a7-6ab8-4f76-8940-7ddc3bb15902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:30.208639 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-795785a7-6ab8-4f76-8940-7ddc3bb15902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:30.562488 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-795785a7-6ab8-4f76-8940-7ddc3bb15902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:30.585599 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-795785a7-6ab8-4f76-8940-7ddc3bb15902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1277 microversion: 2.1 time: 0.400885 Sep 06 04:38:30.603923 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 156/335] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:30 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1277 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:31.137525 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8f9c0c47-8223-4421-a163-a17351f0752e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:31.138129 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8f9c0c47-8223-4421-a163-a17351f0752e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:31.145831 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f9c0c47-8223-4421-a163-a17351f0752e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:31.154125 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f9c0c47-8223-4421-a163-a17351f0752e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:31.154125 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f9c0c47-8223-4421-a163-a17351f0752e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:31.154125 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f9c0c47-8223-4421-a163-a17351f0752e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:31.154125 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f9c0c47-8223-4421-a163-a17351f0752e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:31.154459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f9c0c47-8223-4421-a163-a17351f0752e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:31.529397 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8f9c0c47-8223-4421-a163-a17351f0752e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:31.544907 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8f9c0c47-8223-4421-a163-a17351f0752e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1318 microversion: 2.1 time: 0.411458 Sep 06 04:38:31.549672 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 180/336] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:31 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:31.614461 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9d77223a-6f7c-4e61-8eac-7cf027993d4b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:31.615676 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9d77223a-6f7c-4e61-8eac-7cf027993d4b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:31.622392 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d77223a-6f7c-4e61-8eac-7cf027993d4b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:31.623234 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d77223a-6f7c-4e61-8eac-7cf027993d4b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:31.623891 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d77223a-6f7c-4e61-8eac-7cf027993d4b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:31.624818 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d77223a-6f7c-4e61-8eac-7cf027993d4b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:31.625522 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d77223a-6f7c-4e61-8eac-7cf027993d4b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:31.626189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d77223a-6f7c-4e61-8eac-7cf027993d4b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:31.779545 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9d77223a-6f7c-4e61-8eac-7cf027993d4b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:31.790403 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9d77223a-6f7c-4e61-8eac-7cf027993d4b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.180011 Sep 06 04:38:31.791349 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 157/337] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:31 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:32.002292 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-d8263e8e-4894-409c-8265-ce274c5306e6 req-272ea227-dcf9-4d88-881e-092e30a58c9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aacebb8e-d1b3-4ca8-87ac-3eb37184f747", "tag": "50196b94-245d-464f-b64e-df03a8b65048"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:38:32.022359 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-d8263e8e-4894-409c-8265-ce274c5306e6 req-272ea227-dcf9-4d88-881e-092e30a58c9f service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:32.023096 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-d8263e8e-4894-409c-8265-ce274c5306e6 req-272ea227-dcf9-4d88-881e-092e30a58c9f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:32.023640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-d8263e8e-4894-409c-8265-ce274c5306e6 req-272ea227-dcf9-4d88-881e-092e30a58c9f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:32.045967 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-d8263e8e-4894-409c-8265-ce274c5306e6 req-272ea227-dcf9-4d88-881e-092e30a58c9f service nova] Creating event network-changed:50196b94-245d-464f-b64e-df03a8b65048 for instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 on hv-cinder-85600 Sep 06 04:38:32.055165 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-d8263e8e-4894-409c-8265-ce274c5306e6 req-272ea227-dcf9-4d88-881e-092e30a58c9f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057139 Sep 06 04:38:32.056999 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 181/338] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:38:32.571185 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0771c738-2387-4668-90dc-3ff28434c140 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:32.571935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0771c738-2387-4668-90dc-3ff28434c140 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:32.579932 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0771c738-2387-4668-90dc-3ff28434c140 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:32.581595 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0771c738-2387-4668-90dc-3ff28434c140 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:32.583857 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0771c738-2387-4668-90dc-3ff28434c140 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:32.583857 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0771c738-2387-4668-90dc-3ff28434c140 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:32.583857 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0771c738-2387-4668-90dc-3ff28434c140 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:32.584244 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0771c738-2387-4668-90dc-3ff28434c140 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:32.759898 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0771c738-2387-4668-90dc-3ff28434c140 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:32.767882 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0771c738-2387-4668-90dc-3ff28434c140 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1318 microversion: 2.1 time: 0.201151 Sep 06 04:38:32.768522 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 158/339] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:32 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:38:32.817935 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9db7bfd3-e6e7-40a0-8c58-50528ae6e660 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:32.818633 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9db7bfd3-e6e7-40a0-8c58-50528ae6e660 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:32.825561 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9db7bfd3-e6e7-40a0-8c58-50528ae6e660 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:32.826055 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9db7bfd3-e6e7-40a0-8c58-50528ae6e660 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:32.826489 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9db7bfd3-e6e7-40a0-8c58-50528ae6e660 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:32.827206 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9db7bfd3-e6e7-40a0-8c58-50528ae6e660 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:32.827661 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9db7bfd3-e6e7-40a0-8c58-50528ae6e660 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:32.828084 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9db7bfd3-e6e7-40a0-8c58-50528ae6e660 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:33.067656 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9db7bfd3-e6e7-40a0-8c58-50528ae6e660 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:33.089899 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9db7bfd3-e6e7-40a0-8c58-50528ae6e660 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.268105 Sep 06 04:38:33.091281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 182/340] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:32 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:33.800049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ff366a83-9ccc-443c-91dd-1421e09949c8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:33.800541 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ff366a83-9ccc-443c-91dd-1421e09949c8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:33.803900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:33.815505 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff366a83-9ccc-443c-91dd-1421e09949c8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:33.815998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff366a83-9ccc-443c-91dd-1421e09949c8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:33.816474 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff366a83-9ccc-443c-91dd-1421e09949c8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:33.817407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff366a83-9ccc-443c-91dd-1421e09949c8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:33.817841 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff366a83-9ccc-443c-91dd-1421e09949c8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:33.818245 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff366a83-9ccc-443c-91dd-1421e09949c8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:34.001618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ff366a83-9ccc-443c-91dd-1421e09949c8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:34.015975 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ff366a83-9ccc-443c-91dd-1421e09949c8 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1318 microversion: 2.1 time: 0.222736 Sep 06 04:38:34.016624 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 159/341] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:33 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:38:34.114668 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-df893ab5-294d-4ca2-826b-fb2de4b5a8a5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:34.115284 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-df893ab5-294d-4ca2-826b-fb2de4b5a8a5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:34.117438 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:34.125740 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df893ab5-294d-4ca2-826b-fb2de4b5a8a5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:34.132009 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df893ab5-294d-4ca2-826b-fb2de4b5a8a5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:34.132009 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df893ab5-294d-4ca2-826b-fb2de4b5a8a5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:34.132009 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df893ab5-294d-4ca2-826b-fb2de4b5a8a5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:34.132009 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df893ab5-294d-4ca2-826b-fb2de4b5a8a5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:34.133033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-df893ab5-294d-4ca2-826b-fb2de4b5a8a5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:34.492955 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-df893ab5-294d-4ca2-826b-fb2de4b5a8a5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:34.492955 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-df893ab5-294d-4ca2-826b-fb2de4b5a8a5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.381623 Sep 06 04:38:34.505720 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 183/342] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:34 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:35.046571 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f18cb480-0d5b-437a-ad5e-b90be2cc6137 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:35.048509 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f18cb480-0d5b-437a-ad5e-b90be2cc6137 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:35.057301 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f18cb480-0d5b-437a-ad5e-b90be2cc6137 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:35.060393 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f18cb480-0d5b-437a-ad5e-b90be2cc6137 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:35.060393 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f18cb480-0d5b-437a-ad5e-b90be2cc6137 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:35.060393 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f18cb480-0d5b-437a-ad5e-b90be2cc6137 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:35.060393 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f18cb480-0d5b-437a-ad5e-b90be2cc6137 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:35.060819 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f18cb480-0d5b-437a-ad5e-b90be2cc6137 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:35.086939 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:35.272114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f18cb480-0d5b-437a-ad5e-b90be2cc6137 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:35.280045 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f18cb480-0d5b-437a-ad5e-b90be2cc6137 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1318 microversion: 2.1 time: 0.243363 Sep 06 04:38:35.295850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 160/343] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:35 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:35.521041 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6e6c6536-33be-48b4-bfdf-673ecb4696d0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:35.521041 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6e6c6536-33be-48b4-bfdf-673ecb4696d0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:35.521041 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:35.521692 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:35.527513 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e6c6536-33be-48b4-bfdf-673ecb4696d0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:35.528549 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e6c6536-33be-48b4-bfdf-673ecb4696d0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:35.529151 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e6c6536-33be-48b4-bfdf-673ecb4696d0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:35.530176 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e6c6536-33be-48b4-bfdf-673ecb4696d0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:35.530642 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e6c6536-33be-48b4-bfdf-673ecb4696d0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:35.531071 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e6c6536-33be-48b4-bfdf-673ecb4696d0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:35.720565 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6e6c6536-33be-48b4-bfdf-673ecb4696d0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:35.730746 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6e6c6536-33be-48b4-bfdf-673ecb4696d0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.217709 Sep 06 04:38:35.731448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 184/344] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:35 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:36.303239 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c5dba9b7-2730-4a90-a5ca-c6a0e685c766 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:36.303861 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c5dba9b7-2730-4a90-a5ca-c6a0e685c766 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:36.306653 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:36.311552 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c5dba9b7-2730-4a90-a5ca-c6a0e685c766 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:36.312042 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c5dba9b7-2730-4a90-a5ca-c6a0e685c766 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:36.312480 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c5dba9b7-2730-4a90-a5ca-c6a0e685c766 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:36.313179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c5dba9b7-2730-4a90-a5ca-c6a0e685c766 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:36.313660 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c5dba9b7-2730-4a90-a5ca-c6a0e685c766 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:36.314085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c5dba9b7-2730-4a90-a5ca-c6a0e685c766 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:36.418080 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=12 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:36.496056 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c5dba9b7-2730-4a90-a5ca-c6a0e685c766 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:36.508325 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c5dba9b7-2730-4a90-a5ca-c6a0e685c766 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1318 microversion: 2.1 time: 0.209030 Sep 06 04:38:36.508899 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 161/345] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:36 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:36.755334 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f163db2d-072e-455d-bc77-b319f4cea209 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:36.755960 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f163db2d-072e-455d-bc77-b319f4cea209 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:36.762906 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f163db2d-072e-455d-bc77-b319f4cea209 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:36.763397 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f163db2d-072e-455d-bc77-b319f4cea209 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:36.763886 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f163db2d-072e-455d-bc77-b319f4cea209 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:36.764727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f163db2d-072e-455d-bc77-b319f4cea209 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:36.765034 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f163db2d-072e-455d-bc77-b319f4cea209 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:36.766036 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f163db2d-072e-455d-bc77-b319f4cea209 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:37.144888 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f163db2d-072e-455d-bc77-b319f4cea209 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:37.154791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f163db2d-072e-455d-bc77-b319f4cea209 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.403713 Sep 06 04:38:37.155364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 185/346] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:36 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:37.539620 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-284a4380-0af4-4713-94b3-8a254ee3665a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:37.540511 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-284a4380-0af4-4713-94b3-8a254ee3665a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:37.551353 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-284a4380-0af4-4713-94b3-8a254ee3665a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:37.552055 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-284a4380-0af4-4713-94b3-8a254ee3665a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:37.552654 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-284a4380-0af4-4713-94b3-8a254ee3665a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:37.554262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-284a4380-0af4-4713-94b3-8a254ee3665a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:37.554885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-284a4380-0af4-4713-94b3-8a254ee3665a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:37.555458 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-284a4380-0af4-4713-94b3-8a254ee3665a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:37.668392 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-fb1382df-e2a7-45cb-a344-b86d8d54a8ba req-55ddf0c4-80c3-41b2-95b8-04bfb9369320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d37307-eefc-4b31-b42d-6042e4abee25", "name": "network-vif-plugged", "status": "completed", "tag": "5f1f8c0d-db0b-4d23-89b3-a2a10a3f470f"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:38:37.682582 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-fb1382df-e2a7-45cb-a344-b86d8d54a8ba req-55ddf0c4-80c3-41b2-95b8-04bfb9369320 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:37.691697 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-fb1382df-e2a7-45cb-a344-b86d8d54a8ba req-55ddf0c4-80c3-41b2-95b8-04bfb9369320 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:37.692384 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-fb1382df-e2a7-45cb-a344-b86d8d54a8ba req-55ddf0c4-80c3-41b2-95b8-04bfb9369320 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:37.710634 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-fb1382df-e2a7-45cb-a344-b86d8d54a8ba req-55ddf0c4-80c3-41b2-95b8-04bfb9369320 service nova] Creating event network-vif-plugged:5f1f8c0d-db0b-4d23-89b3-a2a10a3f470f for instance 10d37307-eefc-4b31-b42d-6042e4abee25 on hv-cinder-85600 Sep 06 04:38:37.718238 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-fb1382df-e2a7-45cb-a344-b86d8d54a8ba req-55ddf0c4-80c3-41b2-95b8-04bfb9369320 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053389 Sep 06 04:38:37.727297 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 186/347] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:38:37.774071 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-284a4380-0af4-4713-94b3-8a254ee3665a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:37.783347 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-284a4380-0af4-4713-94b3-8a254ee3665a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1318 microversion: 2.1 time: 0.253272 Sep 06 04:38:37.785292 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 162/348] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:37 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:38.179682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bf5decb7-6193-423d-818a-5df9f9928d3a tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:38.189473 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bf5decb7-6193-423d-818a-5df9f9928d3a tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:38.189473 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf5decb7-6193-423d-818a-5df9f9928d3a tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:38.189473 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf5decb7-6193-423d-818a-5df9f9928d3a tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:38.189473 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf5decb7-6193-423d-818a-5df9f9928d3a tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:38.190382 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf5decb7-6193-423d-818a-5df9f9928d3a tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:38.190382 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf5decb7-6193-423d-818a-5df9f9928d3a tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:38.190382 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf5decb7-6193-423d-818a-5df9f9928d3a tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:38.424854 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bf5decb7-6193-423d-818a-5df9f9928d3a tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:38.440468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bf5decb7-6193-423d-818a-5df9f9928d3a tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.265238 Sep 06 04:38:38.441396 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 187/349] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:38 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:38.808335 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7c16bc43-c5b2-4880-aa02-740c6feeacfc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:38.809530 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7c16bc43-c5b2-4880-aa02-740c6feeacfc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:38.816798 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c16bc43-c5b2-4880-aa02-740c6feeacfc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:38.817572 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c16bc43-c5b2-4880-aa02-740c6feeacfc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:38.818008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c16bc43-c5b2-4880-aa02-740c6feeacfc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:38.818893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c16bc43-c5b2-4880-aa02-740c6feeacfc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:38.819514 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c16bc43-c5b2-4880-aa02-740c6feeacfc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:38.819987 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c16bc43-c5b2-4880-aa02-740c6feeacfc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:38.963807 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7c16bc43-c5b2-4880-aa02-740c6feeacfc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:38.975600 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7c16bc43-c5b2-4880-aa02-740c6feeacfc tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1318 microversion: 2.1 time: 0.172974 Sep 06 04:38:38.976375 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 163/350] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:38 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:38:39.464391 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5171ca57-cf48-4d28-b0d6-441c90463e63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:39.466315 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5171ca57-cf48-4d28-b0d6-441c90463e63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:39.480052 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5171ca57-cf48-4d28-b0d6-441c90463e63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:39.480866 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5171ca57-cf48-4d28-b0d6-441c90463e63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:39.481555 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5171ca57-cf48-4d28-b0d6-441c90463e63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:39.482999 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5171ca57-cf48-4d28-b0d6-441c90463e63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:39.483836 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5171ca57-cf48-4d28-b0d6-441c90463e63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:39.484889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5171ca57-cf48-4d28-b0d6-441c90463e63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:39.714797 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5171ca57-cf48-4d28-b0d6-441c90463e63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:39.723501 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5171ca57-cf48-4d28-b0d6-441c90463e63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.263309 Sep 06 04:38:39.724455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 188/351] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:39 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:40.002573 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4d3e8cc0-397b-4c45-ad7f-a5a430f6ee39 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:40.003837 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4d3e8cc0-397b-4c45-ad7f-a5a430f6ee39 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:40.025096 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d3e8cc0-397b-4c45-ad7f-a5a430f6ee39 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:40.026960 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d3e8cc0-397b-4c45-ad7f-a5a430f6ee39 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:40.027585 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d3e8cc0-397b-4c45-ad7f-a5a430f6ee39 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:40.028991 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d3e8cc0-397b-4c45-ad7f-a5a430f6ee39 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:40.029732 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d3e8cc0-397b-4c45-ad7f-a5a430f6ee39 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:40.032137 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d3e8cc0-397b-4c45-ad7f-a5a430f6ee39 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:40.232013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4d3e8cc0-397b-4c45-ad7f-a5a430f6ee39 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:40.241703 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4d3e8cc0-397b-4c45-ad7f-a5a430f6ee39 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1318 microversion: 2.1 time: 0.246078 Sep 06 04:38:40.253529 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 164/352] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:39 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:40.748233 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2cc304f2-a3fe-41c5-ad19-61de200b9477 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:40.749119 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2cc304f2-a3fe-41c5-ad19-61de200b9477 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:40.755910 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2cc304f2-a3fe-41c5-ad19-61de200b9477 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:40.756396 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2cc304f2-a3fe-41c5-ad19-61de200b9477 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:40.756822 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2cc304f2-a3fe-41c5-ad19-61de200b9477 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:40.757898 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2cc304f2-a3fe-41c5-ad19-61de200b9477 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:40.758674 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2cc304f2-a3fe-41c5-ad19-61de200b9477 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:40.759249 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2cc304f2-a3fe-41c5-ad19-61de200b9477 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:40.809878 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-73701001-cfee-4835-ba7f-d4b371188837 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Action: 'create', calling method: .version_select at 0x7f31766b80d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-813257044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrojrdrR7HoeSKCUDoK+hr7QJMc9yax9vADJxa/s+L+RSelWPO00HAEMen7Nr9AyU6Unmu9sTbgOhIzOiw7gYYTsac/OZsrHe3DK1STfZOWjPDf7ls7oCHMwOhVRa1U2Q=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:38:40.827113 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-73701001-cfee-4835-ba7f-d4b371188837 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Getting quotas for project 17ca991debba43b98c1ad8f0f91c63a9. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:38:40.832243 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-73701001-cfee-4835-ba7f-d4b371188837 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Getting quotas for user 65a8d2df1eed492a874ddaae3235edd0 and project 17ca991debba43b98c1ad8f0f91c63a9. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:38:40.907744 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2cc304f2-a3fe-41c5-ad19-61de200b9477 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:40.916655 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2cc304f2-a3fe-41c5-ad19-61de200b9477 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.172465 Sep 06 04:38:40.917471 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 165/353] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:40 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:40.938708 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-73701001-cfee-4835-ba7f-d4b371188837 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.348913 Sep 06 04:38:40.939398 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 189/354] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Sep 6 04:38:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:38:41.265547 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ac70391f-764c-4f1e-b564-dc89c3827529 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:41.266161 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ac70391f-764c-4f1e-b564-dc89c3827529 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:41.272749 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac70391f-764c-4f1e-b564-dc89c3827529 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:41.273235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac70391f-764c-4f1e-b564-dc89c3827529 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:41.273776 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac70391f-764c-4f1e-b564-dc89c3827529 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:41.291133 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac70391f-764c-4f1e-b564-dc89c3827529 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:41.291133 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac70391f-764c-4f1e-b564-dc89c3827529 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:41.291133 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac70391f-764c-4f1e-b564-dc89c3827529 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:41.444166 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ac70391f-764c-4f1e-b564-dc89c3827529 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:41.452226 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ac70391f-764c-4f1e-b564-dc89c3827529 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1506 microversion: 2.1 time: 0.190495 Sep 06 04:38:41.452883 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 166/355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:41 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:41.939964 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-efb5890c-4d05-4171-b31f-801a388db3f7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:41.940610 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-efb5890c-4d05-4171-b31f-801a388db3f7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:41.946542 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efb5890c-4d05-4171-b31f-801a388db3f7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:41.947021 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efb5890c-4d05-4171-b31f-801a388db3f7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:41.947450 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efb5890c-4d05-4171-b31f-801a388db3f7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:41.948126 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efb5890c-4d05-4171-b31f-801a388db3f7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:41.948577 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efb5890c-4d05-4171-b31f-801a388db3f7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:41.948998 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efb5890c-4d05-4171-b31f-801a388db3f7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:42.114583 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-efb5890c-4d05-4171-b31f-801a388db3f7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:42.132064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-efb5890c-4d05-4171-b31f-801a388db3f7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.189775 Sep 06 04:38:42.132064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 190/356] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:41 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:43.150200 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-de9b38e2-6a15-4019-9109-680855f69320 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:43.151217 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-de9b38e2-6a15-4019-9109-680855f69320 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:43.163552 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-de9b38e2-6a15-4019-9109-680855f69320 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:43.163552 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-de9b38e2-6a15-4019-9109-680855f69320 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:43.163552 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-de9b38e2-6a15-4019-9109-680855f69320 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:43.163552 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-de9b38e2-6a15-4019-9109-680855f69320 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:43.164023 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-de9b38e2-6a15-4019-9109-680855f69320 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:43.164023 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-de9b38e2-6a15-4019-9109-680855f69320 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:43.326907 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-de9b38e2-6a15-4019-9109-680855f69320 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:43.337006 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-de9b38e2-6a15-4019-9109-680855f69320 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.191504 Sep 06 04:38:43.350752 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 167/357] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:43 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:44.361147 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-901b71d5-d9c8-4be6-b9eb-fb0caa1bb5ef tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:44.363010 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-901b71d5-d9c8-4be6-b9eb-fb0caa1bb5ef tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:44.370865 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-901b71d5-d9c8-4be6-b9eb-fb0caa1bb5ef tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:44.371363 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-901b71d5-d9c8-4be6-b9eb-fb0caa1bb5ef tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:44.371801 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-901b71d5-d9c8-4be6-b9eb-fb0caa1bb5ef tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:44.372509 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-901b71d5-d9c8-4be6-b9eb-fb0caa1bb5ef tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:44.373150 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-901b71d5-d9c8-4be6-b9eb-fb0caa1bb5ef tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:44.373763 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-901b71d5-d9c8-4be6-b9eb-fb0caa1bb5ef tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:44.598282 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-901b71d5-d9c8-4be6-b9eb-fb0caa1bb5ef tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:44.604044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-901b71d5-d9c8-4be6-b9eb-fb0caa1bb5ef tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.246833 Sep 06 04:38:44.604615 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 191/358] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:44 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:45.628497 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-640d8544-48f4-4b50-8278-f47c89fea450 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:45.629196 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-640d8544-48f4-4b50-8278-f47c89fea450 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:45.636840 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-640d8544-48f4-4b50-8278-f47c89fea450 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:45.640723 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-640d8544-48f4-4b50-8278-f47c89fea450 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:45.641351 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-640d8544-48f4-4b50-8278-f47c89fea450 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:45.642072 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-640d8544-48f4-4b50-8278-f47c89fea450 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:45.642590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-640d8544-48f4-4b50-8278-f47c89fea450 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:45.642984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-640d8544-48f4-4b50-8278-f47c89fea450 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:45.795795 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-640d8544-48f4-4b50-8278-f47c89fea450 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:45.807100 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-640d8544-48f4-4b50-8278-f47c89fea450 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.183303 Sep 06 04:38:45.807722 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 168/359] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:45 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:46.831429 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-91495bbc-72b1-4909-b96a-10c1a091cb44 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:46.832088 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-91495bbc-72b1-4909-b96a-10c1a091cb44 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:46.837960 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91495bbc-72b1-4909-b96a-10c1a091cb44 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:46.838439 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91495bbc-72b1-4909-b96a-10c1a091cb44 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:46.838875 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91495bbc-72b1-4909-b96a-10c1a091cb44 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:46.839552 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91495bbc-72b1-4909-b96a-10c1a091cb44 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:46.840001 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91495bbc-72b1-4909-b96a-10c1a091cb44 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:46.840421 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91495bbc-72b1-4909-b96a-10c1a091cb44 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:46.967691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-91495bbc-72b1-4909-b96a-10c1a091cb44 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:46.975941 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-91495bbc-72b1-4909-b96a-10c1a091cb44 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.149265 Sep 06 04:38:46.976504 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 192/360] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:46 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:48.000323 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cd1fd754-f2f8-456a-969c-e5a7b50c1c0f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:48.000892 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cd1fd754-f2f8-456a-969c-e5a7b50c1c0f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:48.007030 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd1fd754-f2f8-456a-969c-e5a7b50c1c0f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:48.007578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd1fd754-f2f8-456a-969c-e5a7b50c1c0f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:48.008058 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd1fd754-f2f8-456a-969c-e5a7b50c1c0f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:48.008867 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd1fd754-f2f8-456a-969c-e5a7b50c1c0f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:48.009574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd1fd754-f2f8-456a-969c-e5a7b50c1c0f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:48.010097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd1fd754-f2f8-456a-969c-e5a7b50c1c0f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:48.148793 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cd1fd754-f2f8-456a-969c-e5a7b50c1c0f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:48.156800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cd1fd754-f2f8-456a-969c-e5a7b50c1c0f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.161865 Sep 06 04:38:48.157390 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 169/361] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:47 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:49.180545 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f67cbad4-7e80-4dc6-82ca-ac4d62ae539f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:49.181151 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f67cbad4-7e80-4dc6-82ca-ac4d62ae539f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:49.187083 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f67cbad4-7e80-4dc6-82ca-ac4d62ae539f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:49.187562 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f67cbad4-7e80-4dc6-82ca-ac4d62ae539f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:49.187995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f67cbad4-7e80-4dc6-82ca-ac4d62ae539f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:49.188674 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f67cbad4-7e80-4dc6-82ca-ac4d62ae539f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:49.189168 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f67cbad4-7e80-4dc6-82ca-ac4d62ae539f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:49.189712 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f67cbad4-7e80-4dc6-82ca-ac4d62ae539f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:49.322988 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f67cbad4-7e80-4dc6-82ca-ac4d62ae539f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:49.331614 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f67cbad4-7e80-4dc6-82ca-ac4d62ae539f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.154933 Sep 06 04:38:49.332361 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 193/362] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:49 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:50.354166 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-94711c94-d985-4851-a8e3-fcf5561ad165 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:50.356828 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-94711c94-d985-4851-a8e3-fcf5561ad165 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:50.367457 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-94711c94-d985-4851-a8e3-fcf5561ad165 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:50.367968 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-94711c94-d985-4851-a8e3-fcf5561ad165 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:50.368408 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-94711c94-d985-4851-a8e3-fcf5561ad165 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:50.369430 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-94711c94-d985-4851-a8e3-fcf5561ad165 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:50.370121 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-94711c94-d985-4851-a8e3-fcf5561ad165 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:50.370552 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-94711c94-d985-4851-a8e3-fcf5561ad165 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:50.505570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-94711c94-d985-4851-a8e3-fcf5561ad165 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:50.513757 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-94711c94-d985-4851-a8e3-fcf5561ad165 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.164213 Sep 06 04:38:50.514333 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 170/363] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:50 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:51.537745 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ee67cee7-ed7c-49b2-b018-29713eebf3c7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:51.538396 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ee67cee7-ed7c-49b2-b018-29713eebf3c7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:51.540631 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:51.545399 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee67cee7-ed7c-49b2-b018-29713eebf3c7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:51.545881 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee67cee7-ed7c-49b2-b018-29713eebf3c7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:51.546310 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee67cee7-ed7c-49b2-b018-29713eebf3c7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:51.546995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee67cee7-ed7c-49b2-b018-29713eebf3c7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:51.547444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee67cee7-ed7c-49b2-b018-29713eebf3c7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:51.547860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee67cee7-ed7c-49b2-b018-29713eebf3c7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:51.685191 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ee67cee7-ed7c-49b2-b018-29713eebf3c7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:51.693292 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ee67cee7-ed7c-49b2-b018-29713eebf3c7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.159535 Sep 06 04:38:51.693881 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 194/364] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:51 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:52.719379 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-995174c0-ef1a-4001-a603-134d413a7518 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:52.720038 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-995174c0-ef1a-4001-a603-134d413a7518 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:52.727488 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-995174c0-ef1a-4001-a603-134d413a7518 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:52.727973 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-995174c0-ef1a-4001-a603-134d413a7518 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:52.728410 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-995174c0-ef1a-4001-a603-134d413a7518 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:52.729113 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-995174c0-ef1a-4001-a603-134d413a7518 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:52.729589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-995174c0-ef1a-4001-a603-134d413a7518 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:52.730010 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-995174c0-ef1a-4001-a603-134d413a7518 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:52.871768 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-995174c0-ef1a-4001-a603-134d413a7518 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:52.879445 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-995174c0-ef1a-4001-a603-134d413a7518 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.165751 Sep 06 04:38:52.880008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 171/365] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:52 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:53.904452 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-431b7228-a9e8-4c93-84b4-3e6859e96171 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:53.905062 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-431b7228-a9e8-4c93-84b4-3e6859e96171 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:53.911064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-431b7228-a9e8-4c93-84b4-3e6859e96171 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:53.911545 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-431b7228-a9e8-4c93-84b4-3e6859e96171 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:53.911981 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-431b7228-a9e8-4c93-84b4-3e6859e96171 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:53.912665 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-431b7228-a9e8-4c93-84b4-3e6859e96171 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:53.913114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-431b7228-a9e8-4c93-84b4-3e6859e96171 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:53.913555 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-431b7228-a9e8-4c93-84b4-3e6859e96171 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:54.049392 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-431b7228-a9e8-4c93-84b4-3e6859e96171 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:54.060761 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-431b7228-a9e8-4c93-84b4-3e6859e96171 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.161281 Sep 06 04:38:54.061394 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 195/366] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:53 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:55.087190 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d953f9a9-06f8-4f3f-94c2-c8619646d85f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:55.087685 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d953f9a9-06f8-4f3f-94c2-c8619646d85f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:55.097037 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d953f9a9-06f8-4f3f-94c2-c8619646d85f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:55.097648 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d953f9a9-06f8-4f3f-94c2-c8619646d85f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:55.098434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d953f9a9-06f8-4f3f-94c2-c8619646d85f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:55.099104 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d953f9a9-06f8-4f3f-94c2-c8619646d85f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:55.099560 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d953f9a9-06f8-4f3f-94c2-c8619646d85f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:55.099980 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d953f9a9-06f8-4f3f-94c2-c8619646d85f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:55.256017 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d953f9a9-06f8-4f3f-94c2-c8619646d85f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:55.264948 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d953f9a9-06f8-4f3f-94c2-c8619646d85f tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.182783 Sep 06 04:38:55.265670 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 172/367] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:55 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:38:56.000288 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-0b870d03-bc06-40bd-9032-88b2a68a7d5e req-2e4ab05f-6ace-4af5-a7ef-6116be4596c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacebb8e-d1b3-4ca8-87ac-3eb37184f747", "name": "network-vif-plugged", "status": "completed", "tag": "50196b94-245d-464f-b64e-df03a8b65048"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:38:56.010243 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-0b870d03-bc06-40bd-9032-88b2a68a7d5e req-2e4ab05f-6ace-4af5-a7ef-6116be4596c7 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:56.010711 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-0b870d03-bc06-40bd-9032-88b2a68a7d5e req-2e4ab05f-6ace-4af5-a7ef-6116be4596c7 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:56.011131 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-0b870d03-bc06-40bd-9032-88b2a68a7d5e req-2e4ab05f-6ace-4af5-a7ef-6116be4596c7 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:56.025318 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-0b870d03-bc06-40bd-9032-88b2a68a7d5e req-2e4ab05f-6ace-4af5-a7ef-6116be4596c7 service nova] Creating event network-vif-plugged:50196b94-245d-464f-b64e-df03a8b65048 for instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 on hv-cinder-85600 Sep 06 04:38:56.030859 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-0b870d03-bc06-40bd-9032-88b2a68a7d5e req-2e4ab05f-6ace-4af5-a7ef-6116be4596c7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041217 Sep 06 04:38:56.031566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 196/368] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:38:56.291247 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2597c1ec-5e12-4295-9ff3-6e9116a6c68e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:56.291922 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2597c1ec-5e12-4295-9ff3-6e9116a6c68e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:56.298774 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2597c1ec-5e12-4295-9ff3-6e9116a6c68e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:56.299497 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2597c1ec-5e12-4295-9ff3-6e9116a6c68e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:56.300092 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2597c1ec-5e12-4295-9ff3-6e9116a6c68e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:56.300980 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2597c1ec-5e12-4295-9ff3-6e9116a6c68e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:56.301551 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2597c1ec-5e12-4295-9ff3-6e9116a6c68e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:56.301993 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2597c1ec-5e12-4295-9ff3-6e9116a6c68e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:56.442049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2597c1ec-5e12-4295-9ff3-6e9116a6c68e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:56.451228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2597c1ec-5e12-4295-9ff3-6e9116a6c68e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.164523 Sep 06 04:38:56.451811 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 173/369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:56 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:57.475495 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-883c97db-0d8c-41dc-b133-17462de02694 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:57.476185 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-883c97db-0d8c-41dc-b133-17462de02694 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:57.482977 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-883c97db-0d8c-41dc-b133-17462de02694 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:57.483456 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-883c97db-0d8c-41dc-b133-17462de02694 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:57.483887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-883c97db-0d8c-41dc-b133-17462de02694 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:57.484581 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-883c97db-0d8c-41dc-b133-17462de02694 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:57.485037 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-883c97db-0d8c-41dc-b133-17462de02694 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:57.485553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-883c97db-0d8c-41dc-b133-17462de02694 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:57.621224 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-883c97db-0d8c-41dc-b133-17462de02694 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:57.628967 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-883c97db-0d8c-41dc-b133-17462de02694 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.157752 Sep 06 04:38:57.629548 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 197/370] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:57 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:58.653595 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-570a8d03-6e79-4a3a-ab69-ed23df9be85c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:58.654128 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-570a8d03-6e79-4a3a-ab69-ed23df9be85c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:58.660929 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-570a8d03-6e79-4a3a-ab69-ed23df9be85c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:58.661549 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-570a8d03-6e79-4a3a-ab69-ed23df9be85c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:58.661990 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-570a8d03-6e79-4a3a-ab69-ed23df9be85c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:58.662682 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-570a8d03-6e79-4a3a-ab69-ed23df9be85c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:58.663143 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-570a8d03-6e79-4a3a-ab69-ed23df9be85c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:58.663567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-570a8d03-6e79-4a3a-ab69-ed23df9be85c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:58.675331 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-31613745-b093-4834-ab89-c04594d0f55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:58.675821 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-31613745-b093-4834-ab89-c04594d0f55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:58.681774 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-31613745-b093-4834-ab89-c04594d0f55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:58.682363 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-31613745-b093-4834-ab89-c04594d0f55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:58.682803 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-31613745-b093-4834-ab89-c04594d0f55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:58.683498 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-31613745-b093-4834-ab89-c04594d0f55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:58.684095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-31613745-b093-4834-ab89-c04594d0f55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:58.684521 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-31613745-b093-4834-ab89-c04594d0f55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:58.709903 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-31613745-b093-4834-ab89-c04594d0f55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/ips" status: 200 len: 152 microversion: 2.20 time: 0.038303 Sep 06 04:38:58.710482 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 198/371] 10.222.0.30 () {60 vars in 1289 bytes} [Tue Sep 6 04:38:58 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 04:38:58.806650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-570a8d03-6e79-4a3a-ab69-ed23df9be85c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:58.815563 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-570a8d03-6e79-4a3a-ab69-ed23df9be85c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1265 microversion: 2.1 time: 0.167105 Sep 06 04:38:58.816410 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 174/372] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:58 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:38:59.839350 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7b3a8423-1800-4a62-80e2-7841556c6e50 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:38:59.839965 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7b3a8423-1800-4a62-80e2-7841556c6e50 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:38:59.845859 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3a8423-1800-4a62-80e2-7841556c6e50 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:59.846339 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3a8423-1800-4a62-80e2-7841556c6e50 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:59.846764 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3a8423-1800-4a62-80e2-7841556c6e50 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:59.847440 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3a8423-1800-4a62-80e2-7841556c6e50 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:38:59.847889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3a8423-1800-4a62-80e2-7841556c6e50 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:38:59.848309 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7b3a8423-1800-4a62-80e2-7841556c6e50 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:38:59.850954 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:38:59.983245 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7b3a8423-1800-4a62-80e2-7841556c6e50 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:38:59.991438 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7b3a8423-1800-4a62-80e2-7841556c6e50 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1452 microversion: 2.1 time: 0.156435 Sep 06 04:38:59.995157 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 199/373] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:38:59 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:00.015215 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a4f24082-4235-4e44-8760-e433e7adb5b4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:00.015849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a4f24082-4235-4e44-8760-e433e7adb5b4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:00.022259 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4f24082-4235-4e44-8760-e433e7adb5b4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:00.022745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4f24082-4235-4e44-8760-e433e7adb5b4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:00.023178 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4f24082-4235-4e44-8760-e433e7adb5b4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:00.023870 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4f24082-4235-4e44-8760-e433e7adb5b4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:00.024319 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4f24082-4235-4e44-8760-e433e7adb5b4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:00.024739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4f24082-4235-4e44-8760-e433e7adb5b4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:00.171340 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a4f24082-4235-4e44-8760-e433e7adb5b4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:00.179422 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a4f24082-4235-4e44-8760-e433e7adb5b4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1452 microversion: 2.1 time: 0.168972 Sep 06 04:39:00.179974 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 175/374] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:00 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:02.095866 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-af6e13a3-e0c8-4de5-b233-d5bf84591c2d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:39:02.096443 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-af6e13a3-e0c8-4de5-b233-d5bf84591c2d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:02.102625 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af6e13a3-e0c8-4de5-b233-d5bf84591c2d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:02.103110 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af6e13a3-e0c8-4de5-b233-d5bf84591c2d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:02.103547 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af6e13a3-e0c8-4de5-b233-d5bf84591c2d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:02.104869 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af6e13a3-e0c8-4de5-b233-d5bf84591c2d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:02.105769 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af6e13a3-e0c8-4de5-b233-d5bf84591c2d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:02.106202 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-af6e13a3-e0c8-4de5-b233-d5bf84591c2d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:02.130356 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-af6e13a3-e0c8-4de5-b233-d5bf84591c2d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lazy-loading 'flavor' on Instance uuid 53238a8f-2601-4952-acd2-4dcb02761c12 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:39:02.547510 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-95eacdbd-5bb7-4d54-a60e-20adbf76971b req-27a3599c-d394-4281-bee0-019a9ff2e4c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aacebb8e-d1b3-4ca8-87ac-3eb37184f747", "tag": "50196b94-245d-464f-b64e-df03a8b65048"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:39:02.558057 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-95eacdbd-5bb7-4d54-a60e-20adbf76971b req-27a3599c-d394-4281-bee0-019a9ff2e4c3 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:02.559119 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-95eacdbd-5bb7-4d54-a60e-20adbf76971b req-27a3599c-d394-4281-bee0-019a9ff2e4c3 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:02.559740 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-95eacdbd-5bb7-4d54-a60e-20adbf76971b req-27a3599c-d394-4281-bee0-019a9ff2e4c3 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:02.571559 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-95eacdbd-5bb7-4d54-a60e-20adbf76971b req-27a3599c-d394-4281-bee0-019a9ff2e4c3 service nova] Creating event network-changed:50196b94-245d-464f-b64e-df03a8b65048 for instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 on hv-cinder-85600 Sep 06 04:39:02.577477 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-95eacdbd-5bb7-4d54-a60e-20adbf76971b req-27a3599c-d394-4281-bee0-019a9ff2e4c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033431 Sep 06 04:39:02.578380 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 176/375] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:39:02.661982 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-af6e13a3-e0c8-4de5-b233-d5bf84591c2d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "POST /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/action" status: 202 len: 0 microversion: 2.20 time: 0.569982 Sep 06 04:39:02.666157 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 200/376] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Sep 6 04:39:02 2022] POST /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:39:02.672008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4aca5466-e0c9-414f-a22d-95c2dea1f102 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:02.672685 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4aca5466-e0c9-414f-a22d-95c2dea1f102 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:02.682781 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4aca5466-e0c9-414f-a22d-95c2dea1f102 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:02.685697 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4aca5466-e0c9-414f-a22d-95c2dea1f102 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:02.686951 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4aca5466-e0c9-414f-a22d-95c2dea1f102 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:02.695703 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4aca5466-e0c9-414f-a22d-95c2dea1f102 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:02.695703 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4aca5466-e0c9-414f-a22d-95c2dea1f102 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:02.695703 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4aca5466-e0c9-414f-a22d-95c2dea1f102 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:02.864397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4aca5466-e0c9-414f-a22d-95c2dea1f102 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:02.868536 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:39:02.876893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4aca5466-e0c9-414f-a22d-95c2dea1f102 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:02.878426 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4aca5466-e0c9-414f-a22d-95c2dea1f102 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:02.879639 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4aca5466-e0c9-414f-a22d-95c2dea1f102 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.212129 Sep 06 04:39:02.881691 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 177/377] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:02 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:03.908360 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2002d899-5373-4122-924d-8bb9bbd416d3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:03.909058 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2002d899-5373-4122-924d-8bb9bbd416d3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:03.915637 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2002d899-5373-4122-924d-8bb9bbd416d3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:03.916123 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2002d899-5373-4122-924d-8bb9bbd416d3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:03.917087 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2002d899-5373-4122-924d-8bb9bbd416d3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:03.917904 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2002d899-5373-4122-924d-8bb9bbd416d3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:03.918356 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2002d899-5373-4122-924d-8bb9bbd416d3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:03.918782 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2002d899-5373-4122-924d-8bb9bbd416d3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:04.051887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2002d899-5373-4122-924d-8bb9bbd416d3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:04.060741 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2002d899-5373-4122-924d-8bb9bbd416d3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:04.068234 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2002d899-5373-4122-924d-8bb9bbd416d3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:04.068234 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2002d899-5373-4122-924d-8bb9bbd416d3 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.160437 Sep 06 04:39:04.068234 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 201/378] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:03 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:04.425044 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-40dc7ca6-5dc2-44c6-bd2d-1981c723a45c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:04.425613 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-40dc7ca6-5dc2-44c6-bd2d-1981c723a45c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:04.432759 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40dc7ca6-5dc2-44c6-bd2d-1981c723a45c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:04.434969 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40dc7ca6-5dc2-44c6-bd2d-1981c723a45c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:04.434969 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40dc7ca6-5dc2-44c6-bd2d-1981c723a45c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:04.434969 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40dc7ca6-5dc2-44c6-bd2d-1981c723a45c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:04.434969 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40dc7ca6-5dc2-44c6-bd2d-1981c723a45c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:04.435358 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40dc7ca6-5dc2-44c6-bd2d-1981c723a45c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:04.458710 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-40dc7ca6-5dc2-44c6-bd2d-1981c723a45c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7/ips" status: 200 len: 150 microversion: 2.1 time: 0.037767 Sep 06 04:39:04.459386 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 178/379] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Sep 6 04:39:04 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:39:05.089949 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5ccdae3d-5a07-4558-8ce9-61fd1c208662 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:05.092382 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5ccdae3d-5a07-4558-8ce9-61fd1c208662 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:05.092573 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:39:05.097470 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ccdae3d-5a07-4558-8ce9-61fd1c208662 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:05.097947 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ccdae3d-5a07-4558-8ce9-61fd1c208662 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:05.098369 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ccdae3d-5a07-4558-8ce9-61fd1c208662 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:05.099081 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ccdae3d-5a07-4558-8ce9-61fd1c208662 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:05.099526 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ccdae3d-5a07-4558-8ce9-61fd1c208662 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:05.099942 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ccdae3d-5a07-4558-8ce9-61fd1c208662 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:05.235736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5ccdae3d-5a07-4558-8ce9-61fd1c208662 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:05.244940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5ccdae3d-5a07-4558-8ce9-61fd1c208662 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:05.250300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5ccdae3d-5a07-4558-8ce9-61fd1c208662 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:05.250300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5ccdae3d-5a07-4558-8ce9-61fd1c208662 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.164728 Sep 06 04:39:05.250300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 202/380] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:05 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:06.275705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1db011a6-14aa-401d-837d-f4cbbfd07ac1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:06.276579 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1db011a6-14aa-401d-837d-f4cbbfd07ac1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:06.283767 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1db011a6-14aa-401d-837d-f4cbbfd07ac1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:06.284353 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1db011a6-14aa-401d-837d-f4cbbfd07ac1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:06.284848 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1db011a6-14aa-401d-837d-f4cbbfd07ac1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:06.285656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1db011a6-14aa-401d-837d-f4cbbfd07ac1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:06.286131 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1db011a6-14aa-401d-837d-f4cbbfd07ac1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:06.286667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1db011a6-14aa-401d-837d-f4cbbfd07ac1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:06.418504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1db011a6-14aa-401d-837d-f4cbbfd07ac1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:06.426865 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1db011a6-14aa-401d-837d-f4cbbfd07ac1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:06.428289 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1db011a6-14aa-401d-837d-f4cbbfd07ac1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:06.429482 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1db011a6-14aa-401d-837d-f4cbbfd07ac1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.157709 Sep 06 04:39:06.430041 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 179/381] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:06 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:07.232668 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c725fba8-c02e-4a67-895f-c2e0529a6495 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d7130f6-93c5-4f9a-a091-e2b543452b33"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:39:07.235071 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c725fba8-c02e-4a67-895f-c2e0529a6495 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:07.240824 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c725fba8-c02e-4a67-895f-c2e0529a6495 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:07.241294 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c725fba8-c02e-4a67-895f-c2e0529a6495 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:07.241742 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c725fba8-c02e-4a67-895f-c2e0529a6495 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:07.242415 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c725fba8-c02e-4a67-895f-c2e0529a6495 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:07.242858 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c725fba8-c02e-4a67-895f-c2e0529a6495 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:07.243276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c725fba8-c02e-4a67-895f-c2e0529a6495 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:07.455468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b66ab44b-19fc-44c7-b10a-120b70a7c945 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:07.456019 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b66ab44b-19fc-44c7-b10a-120b70a7c945 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:07.462434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b66ab44b-19fc-44c7-b10a-120b70a7c945 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:07.462921 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b66ab44b-19fc-44c7-b10a-120b70a7c945 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:07.463353 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b66ab44b-19fc-44c7-b10a-120b70a7c945 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:07.464036 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b66ab44b-19fc-44c7-b10a-120b70a7c945 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:07.464486 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b66ab44b-19fc-44c7-b10a-120b70a7c945 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:07.464904 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b66ab44b-19fc-44c7-b10a-120b70a7c945 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:07.602508 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b66ab44b-19fc-44c7-b10a-120b70a7c945 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:07.612130 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b66ab44b-19fc-44c7-b10a-120b70a7c945 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:07.614069 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b66ab44b-19fc-44c7-b10a-120b70a7c945 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:07.615549 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b66ab44b-19fc-44c7-b10a-120b70a7c945 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.163947 Sep 06 04:39:07.616173 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 180/382] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:07 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:39:07.986324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c725fba8-c02e-4a67-895f-c2e0529a6495 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "POST /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.758414 Sep 06 04:39:07.987190 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 203/383] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Sep 6 04:39:07 2022] POST /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7/os-volume_attachments => generated 194 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:39:08.644073 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2e6bb06d-54e3-431c-89d6-8281ca65fb29 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:08.644719 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2e6bb06d-54e3-431c-89d6-8281ca65fb29 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:08.654128 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e6bb06d-54e3-431c-89d6-8281ca65fb29 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:08.654128 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e6bb06d-54e3-431c-89d6-8281ca65fb29 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:08.655319 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e6bb06d-54e3-431c-89d6-8281ca65fb29 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:08.656305 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e6bb06d-54e3-431c-89d6-8281ca65fb29 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:08.659631 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e6bb06d-54e3-431c-89d6-8281ca65fb29 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:08.660105 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e6bb06d-54e3-431c-89d6-8281ca65fb29 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:08.791608 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2e6bb06d-54e3-431c-89d6-8281ca65fb29 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:08.800197 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2e6bb06d-54e3-431c-89d6-8281ca65fb29 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:08.801661 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2e6bb06d-54e3-431c-89d6-8281ca65fb29 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:08.802811 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2e6bb06d-54e3-431c-89d6-8281ca65fb29 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.162836 Sep 06 04:39:08.803367 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 181/384] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:08 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:09.832008 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cb695a88-fbb2-48f4-92ad-460aacf8ed0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:09.832739 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cb695a88-fbb2-48f4-92ad-460aacf8ed0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:09.839092 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb695a88-fbb2-48f4-92ad-460aacf8ed0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:09.839577 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb695a88-fbb2-48f4-92ad-460aacf8ed0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:09.840013 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb695a88-fbb2-48f4-92ad-460aacf8ed0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:09.840700 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb695a88-fbb2-48f4-92ad-460aacf8ed0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:09.841416 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb695a88-fbb2-48f4-92ad-460aacf8ed0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:09.841965 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb695a88-fbb2-48f4-92ad-460aacf8ed0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:09.976244 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cb695a88-fbb2-48f4-92ad-460aacf8ed0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:09.984977 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cb695a88-fbb2-48f4-92ad-460aacf8ed0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:09.986652 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cb695a88-fbb2-48f4-92ad-460aacf8ed0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:09.987903 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cb695a88-fbb2-48f4-92ad-460aacf8ed0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.160781 Sep 06 04:39:09.988519 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 204/385] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:09 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:11.013249 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ce7d014b-5b81-4b32-9241-573187a70ea8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:11.014036 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ce7d014b-5b81-4b32-9241-573187a70ea8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:11.016469 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=42 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:39:11.021099 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce7d014b-5b81-4b32-9241-573187a70ea8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:11.021615 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce7d014b-5b81-4b32-9241-573187a70ea8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:11.022046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce7d014b-5b81-4b32-9241-573187a70ea8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:11.022843 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce7d014b-5b81-4b32-9241-573187a70ea8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:11.023395 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce7d014b-5b81-4b32-9241-573187a70ea8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:11.023690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce7d014b-5b81-4b32-9241-573187a70ea8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:11.155015 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ce7d014b-5b81-4b32-9241-573187a70ea8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:11.163089 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ce7d014b-5b81-4b32-9241-573187a70ea8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:11.164515 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ce7d014b-5b81-4b32-9241-573187a70ea8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:11.165691 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ce7d014b-5b81-4b32-9241-573187a70ea8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.156249 Sep 06 04:39:11.166244 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 182/386] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:11 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:12.191082 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bebc9951-8d46-4e25-b247-7261f996e3d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:12.191694 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bebc9951-8d46-4e25-b247-7261f996e3d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:12.198259 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bebc9951-8d46-4e25-b247-7261f996e3d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:12.198742 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bebc9951-8d46-4e25-b247-7261f996e3d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:12.199177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bebc9951-8d46-4e25-b247-7261f996e3d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:12.199873 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bebc9951-8d46-4e25-b247-7261f996e3d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:12.200326 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bebc9951-8d46-4e25-b247-7261f996e3d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:12.200750 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bebc9951-8d46-4e25-b247-7261f996e3d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:12.334263 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bebc9951-8d46-4e25-b247-7261f996e3d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:12.343048 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bebc9951-8d46-4e25-b247-7261f996e3d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:12.344477 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bebc9951-8d46-4e25-b247-7261f996e3d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:12.345666 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bebc9951-8d46-4e25-b247-7261f996e3d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.158501 Sep 06 04:39:12.346219 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 205/387] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:12 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:13.371066 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-778e5076-d6d6-478a-a9c6-82a6744041ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:13.371678 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-778e5076-d6d6-478a-a9c6-82a6744041ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:13.378793 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-778e5076-d6d6-478a-a9c6-82a6744041ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:13.379304 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-778e5076-d6d6-478a-a9c6-82a6744041ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:13.379736 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-778e5076-d6d6-478a-a9c6-82a6744041ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:13.380418 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-778e5076-d6d6-478a-a9c6-82a6744041ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:13.380867 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-778e5076-d6d6-478a-a9c6-82a6744041ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:13.381284 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-778e5076-d6d6-478a-a9c6-82a6744041ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:13.516379 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-778e5076-d6d6-478a-a9c6-82a6744041ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:13.526740 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-778e5076-d6d6-478a-a9c6-82a6744041ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:13.528617 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-778e5076-d6d6-478a-a9c6-82a6744041ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:13.529837 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-778e5076-d6d6-478a-a9c6-82a6744041ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.162636 Sep 06 04:39:13.530397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 183/388] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:13 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:14.555504 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-068aab25-d5be-4634-bf2a-970df8642922 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:14.556229 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-068aab25-d5be-4634-bf2a-970df8642922 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:14.562791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-068aab25-d5be-4634-bf2a-970df8642922 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:14.563268 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-068aab25-d5be-4634-bf2a-970df8642922 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:14.563763 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-068aab25-d5be-4634-bf2a-970df8642922 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:14.564422 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-068aab25-d5be-4634-bf2a-970df8642922 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:14.564870 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-068aab25-d5be-4634-bf2a-970df8642922 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:14.567767 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-068aab25-d5be-4634-bf2a-970df8642922 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:14.703504 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-068aab25-d5be-4634-bf2a-970df8642922 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:14.711640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-068aab25-d5be-4634-bf2a-970df8642922 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:14.713144 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-068aab25-d5be-4634-bf2a-970df8642922 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:14.714316 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-068aab25-d5be-4634-bf2a-970df8642922 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.162754 Sep 06 04:39:14.714873 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 206/389] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:14 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:39:15.738721 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9b396845-8f8e-4830-9c8f-d4d02fb99e74 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:15.739328 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9b396845-8f8e-4830-9c8f-d4d02fb99e74 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:15.745999 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9b396845-8f8e-4830-9c8f-d4d02fb99e74 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:15.746483 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9b396845-8f8e-4830-9c8f-d4d02fb99e74 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:15.746912 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9b396845-8f8e-4830-9c8f-d4d02fb99e74 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:15.748164 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9b396845-8f8e-4830-9c8f-d4d02fb99e74 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:15.748610 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9b396845-8f8e-4830-9c8f-d4d02fb99e74 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:15.749024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9b396845-8f8e-4830-9c8f-d4d02fb99e74 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:15.889739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9b396845-8f8e-4830-9c8f-d4d02fb99e74 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:15.897974 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9b396845-8f8e-4830-9c8f-d4d02fb99e74 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:15.899402 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9b396845-8f8e-4830-9c8f-d4d02fb99e74 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:15.900603 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9b396845-8f8e-4830-9c8f-d4d02fb99e74 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.165834 Sep 06 04:39:15.901448 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 184/390] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:15 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:16.925428 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-10f07bdf-ba04-4da6-81d1-7fe30bc36dd1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:16.926032 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-10f07bdf-ba04-4da6-81d1-7fe30bc36dd1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:16.932418 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10f07bdf-ba04-4da6-81d1-7fe30bc36dd1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:16.932900 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10f07bdf-ba04-4da6-81d1-7fe30bc36dd1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:16.933354 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10f07bdf-ba04-4da6-81d1-7fe30bc36dd1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:16.934046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10f07bdf-ba04-4da6-81d1-7fe30bc36dd1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:16.935027 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10f07bdf-ba04-4da6-81d1-7fe30bc36dd1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:16.935451 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10f07bdf-ba04-4da6-81d1-7fe30bc36dd1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:17.067257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-10f07bdf-ba04-4da6-81d1-7fe30bc36dd1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:17.075805 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-10f07bdf-ba04-4da6-81d1-7fe30bc36dd1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:17.077333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-10f07bdf-ba04-4da6-81d1-7fe30bc36dd1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:17.078475 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-10f07bdf-ba04-4da6-81d1-7fe30bc36dd1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.156999 Sep 06 04:39:17.079012 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 207/391] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:16 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:17.666545 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c6fcc103-bc37-4836-8f5d-d66a0bcc4ad7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Action: 'create', calling method: .version_select at 0x7f31766b9670>, body: {"keypair": {"name": "tempest-keypair-2056577452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODn1DNRS7tTgZX3WusQHRPk8Xsmr9ioNeOPUkkHCfw9Pf6HQFQnOzV5wn93oorvUw5ppC3MEQ4jDSzIbIQa24KWVBD9ZPyWeV9H10Nc+HJ6JbKOYfomZZixIiNnxvwgCg=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:39:17.682511 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-c6fcc103-bc37-4836-8f5d-d66a0bcc4ad7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for project 3d04ba57221f42d684873d624dbfd283. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:39:17.686323 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-c6fcc103-bc37-4836-8f5d-d66a0bcc4ad7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for user 5a0294ea40914bf290902307a787642d and project 3d04ba57221f42d684873d624dbfd283. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:39:17.806050 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c6fcc103-bc37-4836-8f5d-d66a0bcc4ad7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.143445 Sep 06 04:39:17.806646 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 185/392] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Sep 6 04:39:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:39:18.109741 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b96e3b24-b5d4-4c6e-a734-bf388ffcc6d2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:18.110334 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b96e3b24-b5d4-4c6e-a734-bf388ffcc6d2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:18.117151 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b96e3b24-b5d4-4c6e-a734-bf388ffcc6d2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:18.117665 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b96e3b24-b5d4-4c6e-a734-bf388ffcc6d2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:18.118091 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b96e3b24-b5d4-4c6e-a734-bf388ffcc6d2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:18.118759 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b96e3b24-b5d4-4c6e-a734-bf388ffcc6d2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:18.119284 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b96e3b24-b5d4-4c6e-a734-bf388ffcc6d2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:18.119701 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b96e3b24-b5d4-4c6e-a734-bf388ffcc6d2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:18.257188 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b96e3b24-b5d4-4c6e-a734-bf388ffcc6d2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:18.266339 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b96e3b24-b5d4-4c6e-a734-bf388ffcc6d2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:18.267812 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b96e3b24-b5d4-4c6e-a734-bf388ffcc6d2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:18.273003 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b96e3b24-b5d4-4c6e-a734-bf388ffcc6d2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.163136 Sep 06 04:39:18.273003 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 208/393] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:18 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:19.295904 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5150f4bc-2223-47b5-b5b7-dbe2f8cb911c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:19.300033 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5150f4bc-2223-47b5-b5b7-dbe2f8cb911c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:19.303441 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5150f4bc-2223-47b5-b5b7-dbe2f8cb911c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:19.303932 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5150f4bc-2223-47b5-b5b7-dbe2f8cb911c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:19.304388 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5150f4bc-2223-47b5-b5b7-dbe2f8cb911c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:19.305296 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5150f4bc-2223-47b5-b5b7-dbe2f8cb911c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:19.305755 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5150f4bc-2223-47b5-b5b7-dbe2f8cb911c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:19.306184 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5150f4bc-2223-47b5-b5b7-dbe2f8cb911c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:19.474401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5150f4bc-2223-47b5-b5b7-dbe2f8cb911c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:19.486103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5150f4bc-2223-47b5-b5b7-dbe2f8cb911c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:19.487784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5150f4bc-2223-47b5-b5b7-dbe2f8cb911c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:19.490976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5150f4bc-2223-47b5-b5b7-dbe2f8cb911c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.199700 Sep 06 04:39:19.492285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 186/394] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:19 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:19.963594 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1117080090", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c394cea-216c-4a1f-9277-2bb67bf6a21b"}], "security_groups": [{"name": "tempest-securitygroup--1218086216"}], "key_name": "tempest-keypair-2056577452", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:39:20.071925 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] validate_networks() for [('4c394cea-216c-4a1f-9277-2bb67bf6a21b', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:39:20.444477 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:39:20.444899 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:39:20.445394 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:39:20.445800 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:39:20.446211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:39:20.455920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:20.461839 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:20.461839 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:20.461839 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:20.461839 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:20.463340 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:20.476173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for project 3d04ba57221f42d684873d624dbfd283. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:39:20.480218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for user 5a0294ea40914bf290902307a787642d and project 3d04ba57221f42d684873d624dbfd283. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:39:20.492069 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:39:20.500217 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:39:20.519003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-29128ba1-bd0d-4c38-b022-f69ecd3172d9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:20.519611 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-29128ba1-bd0d-4c38-b022-f69ecd3172d9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:20.534521 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-29128ba1-bd0d-4c38-b022-f69ecd3172d9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:20.535037 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-29128ba1-bd0d-4c38-b022-f69ecd3172d9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:20.535477 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-29128ba1-bd0d-4c38-b022-f69ecd3172d9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:20.536172 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-29128ba1-bd0d-4c38-b022-f69ecd3172d9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:20.536625 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-29128ba1-bd0d-4c38-b022-f69ecd3172d9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:20.537046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-29128ba1-bd0d-4c38-b022-f69ecd3172d9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:20.618153 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ef078e00-c90a-4aed-9249-437aa7518e69 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.658802 Sep 06 04:39:20.622439 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 209/395] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:39:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:39:20.633707 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8d82f710-f7ad-4066-b579-8d1b4e8695e3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:20.634311 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8d82f710-f7ad-4066-b579-8d1b4e8695e3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:20.678308 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-29128ba1-bd0d-4c38-b022-f69ecd3172d9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:20.687622 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-29128ba1-bd0d-4c38-b022-f69ecd3172d9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:20.687772 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8d82f710-f7ad-4066-b579-8d1b4e8695e3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:20.689168 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-29128ba1-bd0d-4c38-b022-f69ecd3172d9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:20.690454 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-29128ba1-bd0d-4c38-b022-f69ecd3172d9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.178143 Sep 06 04:39:20.691179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 187/396] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:20 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:20.694901 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8d82f710-f7ad-4066-b579-8d1b4e8695e3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1242 microversion: 2.1 time: 0.065359 Sep 06 04:39:20.698488 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 210/397] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:20 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:21.716350 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-33082da5-5b54-4ae6-81ec-4bc743f5bdbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:21.717164 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-33082da5-5b54-4ae6-81ec-4bc743f5bdbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:21.720112 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d96f1c45-307d-45ab-825d-b881e274ab64 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:21.720716 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d96f1c45-307d-45ab-825d-b881e274ab64 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:21.724034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33082da5-5b54-4ae6-81ec-4bc743f5bdbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:21.724510 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33082da5-5b54-4ae6-81ec-4bc743f5bdbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:21.724937 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33082da5-5b54-4ae6-81ec-4bc743f5bdbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:21.725649 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33082da5-5b54-4ae6-81ec-4bc743f5bdbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:21.726095 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33082da5-5b54-4ae6-81ec-4bc743f5bdbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:21.726515 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-33082da5-5b54-4ae6-81ec-4bc743f5bdbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:21.727805 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d96f1c45-307d-45ab-825d-b881e274ab64 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:21.728285 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d96f1c45-307d-45ab-825d-b881e274ab64 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:21.728714 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d96f1c45-307d-45ab-825d-b881e274ab64 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:21.729424 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d96f1c45-307d-45ab-825d-b881e274ab64 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:21.729874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d96f1c45-307d-45ab-825d-b881e274ab64 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:21.730295 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d96f1c45-307d-45ab-825d-b881e274ab64 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:21.796893 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d96f1c45-307d-45ab-825d-b881e274ab64 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:21.806570 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d96f1c45-307d-45ab-825d-b881e274ab64 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1246 microversion: 2.1 time: 0.091497 Sep 06 04:39:21.807486 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 211/398] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:21 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:21.859167 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-33082da5-5b54-4ae6-81ec-4bc743f5bdbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:21.867328 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-33082da5-5b54-4ae6-81ec-4bc743f5bdbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:21.868778 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-33082da5-5b54-4ae6-81ec-4bc743f5bdbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:21.870268 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-33082da5-5b54-4ae6-81ec-4bc743f5bdbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.158636 Sep 06 04:39:21.870821 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 188/399] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:21 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:22.829123 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4aab1f58-c7c8-4b50-b7f2-c182bf859097 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:22.829809 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4aab1f58-c7c8-4b50-b7f2-c182bf859097 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:22.836158 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4aab1f58-c7c8-4b50-b7f2-c182bf859097 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:22.836629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4aab1f58-c7c8-4b50-b7f2-c182bf859097 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:22.837056 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4aab1f58-c7c8-4b50-b7f2-c182bf859097 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:22.837762 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4aab1f58-c7c8-4b50-b7f2-c182bf859097 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:22.838209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4aab1f58-c7c8-4b50-b7f2-c182bf859097 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:22.838628 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4aab1f58-c7c8-4b50-b7f2-c182bf859097 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:22.898024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9823a580-35ca-4374-8071-7dff76e9c97c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:22.899124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9823a580-35ca-4374-8071-7dff76e9c97c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:22.901742 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4aab1f58-c7c8-4b50-b7f2-c182bf859097 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:22.911055 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9823a580-35ca-4374-8071-7dff76e9c97c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:22.911894 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9823a580-35ca-4374-8071-7dff76e9c97c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:22.912602 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9823a580-35ca-4374-8071-7dff76e9c97c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:22.913778 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9823a580-35ca-4374-8071-7dff76e9c97c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:22.914521 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9823a580-35ca-4374-8071-7dff76e9c97c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:22.914951 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4aab1f58-c7c8-4b50-b7f2-c182bf859097 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1294 microversion: 2.1 time: 0.089538 Sep 06 04:39:22.915223 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9823a580-35ca-4374-8071-7dff76e9c97c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:22.915889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 212/400] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:22 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:23.051480 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9823a580-35ca-4374-8071-7dff76e9c97c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:23.059466 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9823a580-35ca-4374-8071-7dff76e9c97c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:23.060946 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9823a580-35ca-4374-8071-7dff76e9c97c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:23.062108 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9823a580-35ca-4374-8071-7dff76e9c97c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.168951 Sep 06 04:39:23.062661 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 189/401] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:22 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:39:23.736168 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f47aa272-9b91-422c-a58b-df186d609af0 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19597a5e-fa13-4d3f-9dc3-646bd45738a2", "device": "/dev/sdb"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:39:23.739964 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f47aa272-9b91-422c-a58b-df186d609af0 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:23.747135 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f47aa272-9b91-422c-a58b-df186d609af0 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:23.748241 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f47aa272-9b91-422c-a58b-df186d609af0 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:23.749449 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f47aa272-9b91-422c-a58b-df186d609af0 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:23.750348 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f47aa272-9b91-422c-a58b-df186d609af0 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:23.751028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f47aa272-9b91-422c-a58b-df186d609af0 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:23.751646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f47aa272-9b91-422c-a58b-df186d609af0 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:23.941634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4823a806-d65a-4a8b-91cc-7c8fb2fe048b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:23.943745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4823a806-d65a-4a8b-91cc-7c8fb2fe048b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:23.950813 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4823a806-d65a-4a8b-91cc-7c8fb2fe048b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:23.951296 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4823a806-d65a-4a8b-91cc-7c8fb2fe048b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:23.951727 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4823a806-d65a-4a8b-91cc-7c8fb2fe048b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:23.952426 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4823a806-d65a-4a8b-91cc-7c8fb2fe048b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:23.952920 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4823a806-d65a-4a8b-91cc-7c8fb2fe048b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:23.953361 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4823a806-d65a-4a8b-91cc-7c8fb2fe048b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:23.979155 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:39:24.023716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4823a806-d65a-4a8b-91cc-7c8fb2fe048b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:24.031788 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4823a806-d65a-4a8b-91cc-7c8fb2fe048b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1300 microversion: 2.1 time: 0.094125 Sep 06 04:39:24.032342 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 190/402] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:23 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:24.087820 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1be03df6-72f3-418f-9033-dd60df992e8b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:24.088416 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1be03df6-72f3-418f-9033-dd60df992e8b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:24.098025 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1be03df6-72f3-418f-9033-dd60df992e8b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:24.101361 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1be03df6-72f3-418f-9033-dd60df992e8b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:24.101361 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1be03df6-72f3-418f-9033-dd60df992e8b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:24.101361 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1be03df6-72f3-418f-9033-dd60df992e8b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:24.101361 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1be03df6-72f3-418f-9033-dd60df992e8b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:24.101700 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1be03df6-72f3-418f-9033-dd60df992e8b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:24.253475 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1be03df6-72f3-418f-9033-dd60df992e8b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:24.262921 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1be03df6-72f3-418f-9033-dd60df992e8b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:24.265007 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1be03df6-72f3-418f-9033-dd60df992e8b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:24.266223 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1be03df6-72f3-418f-9033-dd60df992e8b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.182173 Sep 06 04:39:24.266892 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 191/403] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:24 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:39:24.557796 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f47aa272-9b91-422c-a58b-df186d609af0 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "POST /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.826305 Sep 06 04:39:24.558419 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 213/404] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Sep 6 04:39:23 2022] POST /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25/os-volume_attachments => generated 194 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:39:25.026453 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-90a06b60-948e-47cc-922b-2e0778442fba req-44e01b53-509d-4042-878b-e98c99c91b7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16044770-064c-404f-9a5e-c3c493e8a869", "tag": "b5526f44-d0dc-4158-98ba-041cc793f4d7"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:39:25.036426 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-90a06b60-948e-47cc-922b-2e0778442fba req-44e01b53-509d-4042-878b-e98c99c91b7f service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:25.036953 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-90a06b60-948e-47cc-922b-2e0778442fba req-44e01b53-509d-4042-878b-e98c99c91b7f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:25.037418 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-90a06b60-948e-47cc-922b-2e0778442fba req-44e01b53-509d-4042-878b-e98c99c91b7f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:25.049548 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-90a06b60-948e-47cc-922b-2e0778442fba req-44e01b53-509d-4042-878b-e98c99c91b7f service nova] Creating event network-changed:b5526f44-d0dc-4158-98ba-041cc793f4d7 for instance 16044770-064c-404f-9a5e-c3c493e8a869 on hv-cinder-85600 Sep 06 04:39:25.055012 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-90a06b60-948e-47cc-922b-2e0778442fba req-44e01b53-509d-4042-878b-e98c99c91b7f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032377 Sep 06 04:39:25.055785 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 192/405] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:39:25.057141 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3c60f6bb-479b-4b49-9928-14c0388a031c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:25.058390 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3c60f6bb-479b-4b49-9928-14c0388a031c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:25.064955 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c60f6bb-479b-4b49-9928-14c0388a031c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:25.065469 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c60f6bb-479b-4b49-9928-14c0388a031c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:25.065904 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c60f6bb-479b-4b49-9928-14c0388a031c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:25.066601 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c60f6bb-479b-4b49-9928-14c0388a031c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:25.067054 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c60f6bb-479b-4b49-9928-14c0388a031c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:25.067474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c60f6bb-479b-4b49-9928-14c0388a031c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:25.198910 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3c60f6bb-479b-4b49-9928-14c0388a031c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:25.206662 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3c60f6bb-479b-4b49-9928-14c0388a031c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.154379 Sep 06 04:39:25.207333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 214/406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:25 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:25.292701 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b77cb45d-9068-426e-be58-8dff454f5ac2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:25.293459 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b77cb45d-9068-426e-be58-8dff454f5ac2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:25.300202 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b77cb45d-9068-426e-be58-8dff454f5ac2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:25.300673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b77cb45d-9068-426e-be58-8dff454f5ac2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:25.301097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b77cb45d-9068-426e-be58-8dff454f5ac2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:25.301805 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b77cb45d-9068-426e-be58-8dff454f5ac2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:25.302245 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b77cb45d-9068-426e-be58-8dff454f5ac2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:25.302655 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b77cb45d-9068-426e-be58-8dff454f5ac2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:25.436915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b77cb45d-9068-426e-be58-8dff454f5ac2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:25.445694 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b77cb45d-9068-426e-be58-8dff454f5ac2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:25.447185 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b77cb45d-9068-426e-be58-8dff454f5ac2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:25.448442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b77cb45d-9068-426e-be58-8dff454f5ac2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.160001 Sep 06 04:39:25.449012 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 193/407] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:25 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:26.230525 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-27825bc1-7300-4914-926d-f98c74c20871 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:26.232423 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-27825bc1-7300-4914-926d-f98c74c20871 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:26.239139 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27825bc1-7300-4914-926d-f98c74c20871 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:26.239615 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27825bc1-7300-4914-926d-f98c74c20871 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:26.240045 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27825bc1-7300-4914-926d-f98c74c20871 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:26.240737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27825bc1-7300-4914-926d-f98c74c20871 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:26.241185 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27825bc1-7300-4914-926d-f98c74c20871 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:26.241702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27825bc1-7300-4914-926d-f98c74c20871 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:26.375768 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-27825bc1-7300-4914-926d-f98c74c20871 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:26.383737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-27825bc1-7300-4914-926d-f98c74c20871 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.157418 Sep 06 04:39:26.384359 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 215/408] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:26 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:26.474917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0ae11ed7-c069-44e4-8df7-e1e838af2b43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:26.475515 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0ae11ed7-c069-44e4-8df7-e1e838af2b43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:26.482777 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ae11ed7-c069-44e4-8df7-e1e838af2b43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:26.483187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ae11ed7-c069-44e4-8df7-e1e838af2b43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:26.483613 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ae11ed7-c069-44e4-8df7-e1e838af2b43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:26.484287 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ae11ed7-c069-44e4-8df7-e1e838af2b43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:26.484730 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ae11ed7-c069-44e4-8df7-e1e838af2b43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:26.485143 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ae11ed7-c069-44e4-8df7-e1e838af2b43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:26.614904 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0ae11ed7-c069-44e4-8df7-e1e838af2b43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:26.622860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0ae11ed7-c069-44e4-8df7-e1e838af2b43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:26.624288 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0ae11ed7-c069-44e4-8df7-e1e838af2b43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:26.625485 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0ae11ed7-c069-44e4-8df7-e1e838af2b43 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.154423 Sep 06 04:39:26.626044 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 194/409] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:26 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:26.957218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-484875739", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-813257044", "security_groups": [{"name": "tempest-secgroup-smoke-1745857450"}], "networks": [{"uuid": "79930370-1c5e-497c-9fc8-53811a3907a9"}], "block_device_mapping_v2": [{"uuid": "08eef0b9-7c12-4ca8-8d27-dc63cb331740", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:39:27.070955 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] validate_networks() for [('79930370-1c5e-497c-9fc8-53811a3907a9', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:39:27.407586 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-43063e18-b55e-4bcb-b88c-94c4803dc845 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:27.408385 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-43063e18-b55e-4bcb-b88c-94c4803dc845 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:27.414328 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43063e18-b55e-4bcb-b88c-94c4803dc845 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:27.414796 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43063e18-b55e-4bcb-b88c-94c4803dc845 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:27.415217 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43063e18-b55e-4bcb-b88c-94c4803dc845 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:27.416064 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43063e18-b55e-4bcb-b88c-94c4803dc845 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:27.416542 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43063e18-b55e-4bcb-b88c-94c4803dc845 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:27.416952 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43063e18-b55e-4bcb-b88c-94c4803dc845 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:27.443803 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:39:27.444300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:39:27.444680 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:39:27.445083 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:39:27.445525 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:39:27.455331 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:27.455807 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:27.456245 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:27.456983 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:27.457466 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:27.457887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:27.474772 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Getting quotas for project 17ca991debba43b98c1ad8f0f91c63a9. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:39:27.478698 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Getting quotas for user 65a8d2df1eed492a874ddaae3235edd0 and project 17ca991debba43b98c1ad8f0f91c63a9. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:39:27.537713 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:39:27.539868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08eef0b9-7c12-4ca8-8d27-dc63cb331740',volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:39:27.548152 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-43063e18-b55e-4bcb-b88c-94c4803dc845 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:27.557044 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-43063e18-b55e-4bcb-b88c-94c4803dc845 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.153697 Sep 06 04:39:27.557711 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 195/410] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:27 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:27.659637 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0ffdbb26-ea26-497b-a345-d99a525650fd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:27.660230 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0ffdbb26-ea26-497b-a345-d99a525650fd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:27.666166 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ffdbb26-ea26-497b-a345-d99a525650fd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:27.666640 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ffdbb26-ea26-497b-a345-d99a525650fd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:27.672995 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ffdbb26-ea26-497b-a345-d99a525650fd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:27.672995 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ffdbb26-ea26-497b-a345-d99a525650fd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:27.672995 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ffdbb26-ea26-497b-a345-d99a525650fd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:27.672995 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ffdbb26-ea26-497b-a345-d99a525650fd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:27.683897 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:39:27.698480 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:39:27.804854 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0ffdbb26-ea26-497b-a345-d99a525650fd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:27.812077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0ffdbb26-ea26-497b-a345-d99a525650fd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:27.813596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0ffdbb26-ea26-497b-a345-d99a525650fd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:27.814885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0ffdbb26-ea26-497b-a345-d99a525650fd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.159216 Sep 06 04:39:27.815443 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 196/411] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:27 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:39:27.894446 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ac6630f2-3493-4fa4-a40f-504a1ca20ac1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.944098 Sep 06 04:39:27.895460 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 216/412] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:39:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:39:27.906659 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7cc3ccd1-2020-432e-b1ef-0b93119f2772 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:27.907263 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7cc3ccd1-2020-432e-b1ef-0b93119f2772 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:27.960323 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7cc3ccd1-2020-432e-b1ef-0b93119f2772 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:27.967184 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7cc3ccd1-2020-432e-b1ef-0b93119f2772 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1087 microversion: 2.1 time: 0.064468 Sep 06 04:39:27.967786 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 197/413] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:27 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1087 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:28.581197 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3bb9da04-3696-40f6-a98b-f3bd141d962a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:28.581844 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3bb9da04-3696-40f6-a98b-f3bd141d962a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:28.587892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3bb9da04-3696-40f6-a98b-f3bd141d962a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:28.588372 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3bb9da04-3696-40f6-a98b-f3bd141d962a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:28.588799 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3bb9da04-3696-40f6-a98b-f3bd141d962a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:28.589610 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3bb9da04-3696-40f6-a98b-f3bd141d962a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:28.590063 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3bb9da04-3696-40f6-a98b-f3bd141d962a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:28.590508 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3bb9da04-3696-40f6-a98b-f3bd141d962a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:28.719250 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3bb9da04-3696-40f6-a98b-f3bd141d962a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:28.726837 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3bb9da04-3696-40f6-a98b-f3bd141d962a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.150158 Sep 06 04:39:28.727914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 217/414] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:28 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:28.843713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c1fbf406-ffe0-4b61-a300-ae5fc4aa215d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:28.843713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c1fbf406-ffe0-4b61-a300-ae5fc4aa215d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:28.849606 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1fbf406-ffe0-4b61-a300-ae5fc4aa215d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:28.850170 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1fbf406-ffe0-4b61-a300-ae5fc4aa215d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:28.850670 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1fbf406-ffe0-4b61-a300-ae5fc4aa215d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:28.851430 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1fbf406-ffe0-4b61-a300-ae5fc4aa215d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:28.851981 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1fbf406-ffe0-4b61-a300-ae5fc4aa215d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:28.852467 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1fbf406-ffe0-4b61-a300-ae5fc4aa215d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:28.990144 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cde11f89-a419-4cd7-b0e4-3b8a23b2320c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:28.990785 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cde11f89-a419-4cd7-b0e4-3b8a23b2320c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:28.996659 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cde11f89-a419-4cd7-b0e4-3b8a23b2320c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:28.997940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cde11f89-a419-4cd7-b0e4-3b8a23b2320c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:28.998514 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cde11f89-a419-4cd7-b0e4-3b8a23b2320c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:28.999204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cde11f89-a419-4cd7-b0e4-3b8a23b2320c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:28.999660 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cde11f89-a419-4cd7-b0e4-3b8a23b2320c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:29.000086 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cde11f89-a419-4cd7-b0e4-3b8a23b2320c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:29.002075 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c1fbf406-ffe0-4b61-a300-ae5fc4aa215d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:29.010336 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c1fbf406-ffe0-4b61-a300-ae5fc4aa215d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:29.011761 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c1fbf406-ffe0-4b61-a300-ae5fc4aa215d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:29.013729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c1fbf406-ffe0-4b61-a300-ae5fc4aa215d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.177475 Sep 06 04:39:29.014346 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 198/415] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:28 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:39:29.064783 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cde11f89-a419-4cd7-b0e4-3b8a23b2320c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:29.072279 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cde11f89-a419-4cd7-b0e4-3b8a23b2320c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1137 microversion: 2.1 time: 0.085972 Sep 06 04:39:29.072837 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 218/416] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:28 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:29.751139 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6023e4db-4050-41d3-9802-597f9ef7d2c2 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:29.751658 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6023e4db-4050-41d3-9802-597f9ef7d2c2 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:29.757594 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6023e4db-4050-41d3-9802-597f9ef7d2c2 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:29.758065 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6023e4db-4050-41d3-9802-597f9ef7d2c2 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:29.758493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6023e4db-4050-41d3-9802-597f9ef7d2c2 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:29.759159 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6023e4db-4050-41d3-9802-597f9ef7d2c2 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:29.759603 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6023e4db-4050-41d3-9802-597f9ef7d2c2 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:29.760015 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6023e4db-4050-41d3-9802-597f9ef7d2c2 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:29.896612 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6023e4db-4050-41d3-9802-597f9ef7d2c2 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:29.904266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6023e4db-4050-41d3-9802-597f9ef7d2c2 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.157637 Sep 06 04:39:29.905618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 199/417] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:29 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:30.040169 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-766128fb-3194-4f11-99fe-8abda10a0cc9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:30.040824 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-766128fb-3194-4f11-99fe-8abda10a0cc9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:30.048164 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-766128fb-3194-4f11-99fe-8abda10a0cc9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:30.048652 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-766128fb-3194-4f11-99fe-8abda10a0cc9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:30.049088 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-766128fb-3194-4f11-99fe-8abda10a0cc9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:30.049807 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-766128fb-3194-4f11-99fe-8abda10a0cc9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:30.050259 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-766128fb-3194-4f11-99fe-8abda10a0cc9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:30.050681 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-766128fb-3194-4f11-99fe-8abda10a0cc9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:30.095083 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-03d36652-1462-46d4-bd93-5b438fdf02bd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:30.095692 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-03d36652-1462-46d4-bd93-5b438fdf02bd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:30.101664 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03d36652-1462-46d4-bd93-5b438fdf02bd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:30.102158 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03d36652-1462-46d4-bd93-5b438fdf02bd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:30.102579 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03d36652-1462-46d4-bd93-5b438fdf02bd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:30.103277 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03d36652-1462-46d4-bd93-5b438fdf02bd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:30.103722 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03d36652-1462-46d4-bd93-5b438fdf02bd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:30.104140 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-03d36652-1462-46d4-bd93-5b438fdf02bd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:30.170181 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-03d36652-1462-46d4-bd93-5b438fdf02bd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:30.179580 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-03d36652-1462-46d4-bd93-5b438fdf02bd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1137 microversion: 2.1 time: 0.088369 Sep 06 04:39:30.180378 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 200/418] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:30 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1137 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:30.185872 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-766128fb-3194-4f11-99fe-8abda10a0cc9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:30.195414 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-766128fb-3194-4f11-99fe-8abda10a0cc9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:30.196891 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-766128fb-3194-4f11-99fe-8abda10a0cc9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:30.198153 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-766128fb-3194-4f11-99fe-8abda10a0cc9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.161947 Sep 06 04:39:30.198780 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 219/419] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:30 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:30.927540 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fce9397c-14ac-424a-85fb-42d14dc26d68 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:30.928143 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fce9397c-14ac-424a-85fb-42d14dc26d68 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:30.934808 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fce9397c-14ac-424a-85fb-42d14dc26d68 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:30.935393 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fce9397c-14ac-424a-85fb-42d14dc26d68 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:30.935821 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fce9397c-14ac-424a-85fb-42d14dc26d68 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:30.936602 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fce9397c-14ac-424a-85fb-42d14dc26d68 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:30.937108 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fce9397c-14ac-424a-85fb-42d14dc26d68 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:30.937476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fce9397c-14ac-424a-85fb-42d14dc26d68 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:31.070713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fce9397c-14ac-424a-85fb-42d14dc26d68 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:31.078571 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fce9397c-14ac-424a-85fb-42d14dc26d68 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.154817 Sep 06 04:39:31.079128 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 201/420] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:30 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:31.203109 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-15747884-78a1-493e-af7b-466050482277 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:31.203720 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-15747884-78a1-493e-af7b-466050482277 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:31.210335 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-15747884-78a1-493e-af7b-466050482277 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:31.210818 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-15747884-78a1-493e-af7b-466050482277 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:31.211249 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-15747884-78a1-493e-af7b-466050482277 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:31.211928 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-15747884-78a1-493e-af7b-466050482277 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:31.212381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-15747884-78a1-493e-af7b-466050482277 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:31.212801 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-15747884-78a1-493e-af7b-466050482277 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:31.224200 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d41f6054-8f02-42b4-ba51-41c2953d63b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:31.224801 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d41f6054-8f02-42b4-ba51-41c2953d63b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:31.230641 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d41f6054-8f02-42b4-ba51-41c2953d63b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:31.231161 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d41f6054-8f02-42b4-ba51-41c2953d63b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:31.232373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d41f6054-8f02-42b4-ba51-41c2953d63b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:31.233191 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d41f6054-8f02-42b4-ba51-41c2953d63b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:31.233687 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d41f6054-8f02-42b4-ba51-41c2953d63b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:31.234108 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d41f6054-8f02-42b4-ba51-41c2953d63b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:31.273404 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-15747884-78a1-493e-af7b-466050482277 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:31.281916 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-15747884-78a1-493e-af7b-466050482277 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1137 microversion: 2.1 time: 0.082678 Sep 06 04:39:31.282649 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 220/421] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:31 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:31.364140 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d41f6054-8f02-42b4-ba51-41c2953d63b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:31.372560 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d41f6054-8f02-42b4-ba51-41c2953d63b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:31.374058 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d41f6054-8f02-42b4-ba51-41c2953d63b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:31.375219 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d41f6054-8f02-42b4-ba51-41c2953d63b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.154811 Sep 06 04:39:31.375778 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 202/422] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:31 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:39:32.121508 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9efddf5f-9331-4725-ac1c-ee82dffa1894 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:32.121508 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9efddf5f-9331-4725-ac1c-ee82dffa1894 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:32.121508 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9efddf5f-9331-4725-ac1c-ee82dffa1894 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:32.121508 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9efddf5f-9331-4725-ac1c-ee82dffa1894 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:32.122219 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9efddf5f-9331-4725-ac1c-ee82dffa1894 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:32.122219 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9efddf5f-9331-4725-ac1c-ee82dffa1894 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:32.122219 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9efddf5f-9331-4725-ac1c-ee82dffa1894 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:32.122219 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9efddf5f-9331-4725-ac1c-ee82dffa1894 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:32.220643 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-028af15b-50fb-4633-942d-285a6e1780bc req-0127f82d-b976-423d-b4d5-bbdfd94767f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53238a8f-2601-4952-acd2-4dcb02761c12", "name": "network-vif-plugged", "status": "completed", "tag": "19322183-60e8-44ac-b690-7448dfce3250"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:39:32.231949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-028af15b-50fb-4633-942d-285a6e1780bc req-0127f82d-b976-423d-b4d5-bbdfd94767f5 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:32.232494 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-028af15b-50fb-4633-942d-285a6e1780bc req-0127f82d-b976-423d-b4d5-bbdfd94767f5 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:32.232998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-028af15b-50fb-4633-942d-285a6e1780bc req-0127f82d-b976-423d-b4d5-bbdfd94767f5 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:32.244592 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-028af15b-50fb-4633-942d-285a6e1780bc req-0127f82d-b976-423d-b4d5-bbdfd94767f5 service nova] Creating event network-vif-plugged:19322183-60e8-44ac-b690-7448dfce3250 for instance 53238a8f-2601-4952-acd2-4dcb02761c12 on hv-cinder-85600 Sep 06 04:39:32.250162 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-028af15b-50fb-4633-942d-285a6e1780bc req-0127f82d-b976-423d-b4d5-bbdfd94767f5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033136 Sep 06 04:39:32.250811 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 203/423] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:39:32.256329 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9efddf5f-9331-4725-ac1c-ee82dffa1894 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:32.264629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9efddf5f-9331-4725-ac1c-ee82dffa1894 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.156087 Sep 06 04:39:32.267656 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 221/424] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:32 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:32.305766 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d6a27e0f-84eb-4aa1-88ed-f2ef58934e0a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:32.306540 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d6a27e0f-84eb-4aa1-88ed-f2ef58934e0a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:32.314059 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6a27e0f-84eb-4aa1-88ed-f2ef58934e0a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:32.314609 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6a27e0f-84eb-4aa1-88ed-f2ef58934e0a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:32.315110 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6a27e0f-84eb-4aa1-88ed-f2ef58934e0a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:32.315896 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6a27e0f-84eb-4aa1-88ed-f2ef58934e0a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:32.316456 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6a27e0f-84eb-4aa1-88ed-f2ef58934e0a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:32.317120 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6a27e0f-84eb-4aa1-88ed-f2ef58934e0a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:32.382615 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d6a27e0f-84eb-4aa1-88ed-f2ef58934e0a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:32.391022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d6a27e0f-84eb-4aa1-88ed-f2ef58934e0a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1137 microversion: 2.1 time: 0.089598 Sep 06 04:39:32.391585 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 204/425] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:32 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:32.399963 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f46d4010-dc1f-4db7-a7ef-34ae7f5a6a1a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:32.400570 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f46d4010-dc1f-4db7-a7ef-34ae7f5a6a1a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:32.406770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f46d4010-dc1f-4db7-a7ef-34ae7f5a6a1a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:32.407446 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f46d4010-dc1f-4db7-a7ef-34ae7f5a6a1a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:32.408179 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f46d4010-dc1f-4db7-a7ef-34ae7f5a6a1a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:32.408868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f46d4010-dc1f-4db7-a7ef-34ae7f5a6a1a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:32.409333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f46d4010-dc1f-4db7-a7ef-34ae7f5a6a1a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:32.409778 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f46d4010-dc1f-4db7-a7ef-34ae7f5a6a1a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:32.534274 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f46d4010-dc1f-4db7-a7ef-34ae7f5a6a1a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:32.542194 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f46d4010-dc1f-4db7-a7ef-34ae7f5a6a1a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:32.544313 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f46d4010-dc1f-4db7-a7ef-34ae7f5a6a1a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:32.545559 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f46d4010-dc1f-4db7-a7ef-34ae7f5a6a1a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.149529 Sep 06 04:39:32.546115 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 222/426] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:32 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:33.288206 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b67260d2-4080-4188-9331-469560c03473 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:33.288745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b67260d2-4080-4188-9331-469560c03473 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:33.296097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b67260d2-4080-4188-9331-469560c03473 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:33.296611 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b67260d2-4080-4188-9331-469560c03473 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:33.297046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b67260d2-4080-4188-9331-469560c03473 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:33.297781 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b67260d2-4080-4188-9331-469560c03473 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:33.298235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b67260d2-4080-4188-9331-469560c03473 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:33.298659 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b67260d2-4080-4188-9331-469560c03473 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:33.414841 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-34fd446a-1930-4181-a324-9c42292f21b6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:33.416121 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-34fd446a-1930-4181-a324-9c42292f21b6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:33.423929 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-34fd446a-1930-4181-a324-9c42292f21b6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:33.424799 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-34fd446a-1930-4181-a324-9c42292f21b6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:33.425475 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-34fd446a-1930-4181-a324-9c42292f21b6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:33.426752 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-34fd446a-1930-4181-a324-9c42292f21b6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:33.427493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-34fd446a-1930-4181-a324-9c42292f21b6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:33.428003 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-34fd446a-1930-4181-a324-9c42292f21b6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:33.437007 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b67260d2-4080-4188-9331-469560c03473 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:33.445221 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b67260d2-4080-4188-9331-469560c03473 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.160995 Sep 06 04:39:33.446222 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 205/427] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:33 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:33.540994 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-34fd446a-1930-4181-a324-9c42292f21b6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:33.549412 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-34fd446a-1930-4181-a324-9c42292f21b6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1129 microversion: 2.1 time: 0.138321 Sep 06 04:39:33.549987 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 223/428] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:33 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1129 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:33.570982 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bab7d552-720e-40e7-ada9-3f517e638680 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:33.571665 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bab7d552-720e-40e7-ada9-3f517e638680 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:33.578109 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bab7d552-720e-40e7-ada9-3f517e638680 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:33.580650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bab7d552-720e-40e7-ada9-3f517e638680 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:33.580650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bab7d552-720e-40e7-ada9-3f517e638680 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:33.580650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bab7d552-720e-40e7-ada9-3f517e638680 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:33.580650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bab7d552-720e-40e7-ada9-3f517e638680 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:33.581341 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bab7d552-720e-40e7-ada9-3f517e638680 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:33.726310 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bab7d552-720e-40e7-ada9-3f517e638680 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:33.735265 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bab7d552-720e-40e7-ada9-3f517e638680 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:33.736686 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bab7d552-720e-40e7-ada9-3f517e638680 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:33.737869 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bab7d552-720e-40e7-ada9-3f517e638680 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.170852 Sep 06 04:39:33.738421 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 206/429] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:33 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:34.473222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8f7a774d-b1e4-4c95-bf93-2149ce8daac6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:34.473855 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8f7a774d-b1e4-4c95-bf93-2149ce8daac6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:34.480482 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f7a774d-b1e4-4c95-bf93-2149ce8daac6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:34.481488 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f7a774d-b1e4-4c95-bf93-2149ce8daac6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:34.481946 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f7a774d-b1e4-4c95-bf93-2149ce8daac6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:34.482622 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f7a774d-b1e4-4c95-bf93-2149ce8daac6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:34.483153 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f7a774d-b1e4-4c95-bf93-2149ce8daac6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:34.483558 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f7a774d-b1e4-4c95-bf93-2149ce8daac6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:34.576734 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4d0dedba-dec9-4c72-ac18-5f960381e44b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:34.578089 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4d0dedba-dec9-4c72-ac18-5f960381e44b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:34.585039 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d0dedba-dec9-4c72-ac18-5f960381e44b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:34.585683 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d0dedba-dec9-4c72-ac18-5f960381e44b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:34.586212 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d0dedba-dec9-4c72-ac18-5f960381e44b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:34.587063 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d0dedba-dec9-4c72-ac18-5f960381e44b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:34.587626 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d0dedba-dec9-4c72-ac18-5f960381e44b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:34.588145 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d0dedba-dec9-4c72-ac18-5f960381e44b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:34.643529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8f7a774d-b1e4-4c95-bf93-2149ce8daac6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:34.643529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8f7a774d-b1e4-4c95-bf93-2149ce8daac6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.175641 Sep 06 04:39:34.643529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 224/430] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:34 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:34.656771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4d0dedba-dec9-4c72-ac18-5f960381e44b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:34.664976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4d0dedba-dec9-4c72-ac18-5f960381e44b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1185 microversion: 2.1 time: 0.092747 Sep 06 04:39:34.665568 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 207/431] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:34 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:34.763704 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-73de3014-ed7c-478e-ba0b-a04d20715670 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:34.764392 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-73de3014-ed7c-478e-ba0b-a04d20715670 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:34.770400 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73de3014-ed7c-478e-ba0b-a04d20715670 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:34.773043 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73de3014-ed7c-478e-ba0b-a04d20715670 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:34.773043 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73de3014-ed7c-478e-ba0b-a04d20715670 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:34.773043 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73de3014-ed7c-478e-ba0b-a04d20715670 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:34.773043 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73de3014-ed7c-478e-ba0b-a04d20715670 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:34.773559 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-73de3014-ed7c-478e-ba0b-a04d20715670 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:34.906521 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-73de3014-ed7c-478e-ba0b-a04d20715670 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:34.914795 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-73de3014-ed7c-478e-ba0b-a04d20715670 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:34.916245 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-73de3014-ed7c-478e-ba0b-a04d20715670 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:34.917479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-73de3014-ed7c-478e-ba0b-a04d20715670 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.157742 Sep 06 04:39:34.918032 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 225/432] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:34 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:35.668634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3fa9fd63-90e4-48c0-8cbb-4e12d0bff029 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:35.670294 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3fa9fd63-90e4-48c0-8cbb-4e12d0bff029 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:35.678533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fa9fd63-90e4-48c0-8cbb-4e12d0bff029 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:35.681009 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fa9fd63-90e4-48c0-8cbb-4e12d0bff029 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:35.681009 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fa9fd63-90e4-48c0-8cbb-4e12d0bff029 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:35.681009 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fa9fd63-90e4-48c0-8cbb-4e12d0bff029 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:35.681009 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fa9fd63-90e4-48c0-8cbb-4e12d0bff029 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:35.681479 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fa9fd63-90e4-48c0-8cbb-4e12d0bff029 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:35.688295 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a8138c2f-fc77-4f50-be6a-9f2f1f5fc2a7 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:35.689476 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a8138c2f-fc77-4f50-be6a-9f2f1f5fc2a7 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:35.697984 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8138c2f-fc77-4f50-be6a-9f2f1f5fc2a7 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:35.700084 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8138c2f-fc77-4f50-be6a-9f2f1f5fc2a7 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:35.700695 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8138c2f-fc77-4f50-be6a-9f2f1f5fc2a7 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:35.705218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8138c2f-fc77-4f50-be6a-9f2f1f5fc2a7 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:35.705873 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8138c2f-fc77-4f50-be6a-9f2f1f5fc2a7 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:35.706476 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8138c2f-fc77-4f50-be6a-9f2f1f5fc2a7 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:35.788413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a8138c2f-fc77-4f50-be6a-9f2f1f5fc2a7 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:35.799416 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a8138c2f-fc77-4f50-be6a-9f2f1f5fc2a7 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1203 microversion: 2.1 time: 0.115356 Sep 06 04:39:35.813362 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 226/433] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:35 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1203 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:35.823371 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-1c14fda5-0e56-4050-a743-aff1b57d91a4 req-6a67c848-6cda-45e5-92b6-5ed922f6624b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16044770-064c-404f-9a5e-c3c493e8a869", "name": "network-vif-plugged", "status": "completed", "tag": "b5526f44-d0dc-4158-98ba-041cc793f4d7"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:39:35.834548 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-1c14fda5-0e56-4050-a743-aff1b57d91a4 req-6a67c848-6cda-45e5-92b6-5ed922f6624b service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:35.836122 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-1c14fda5-0e56-4050-a743-aff1b57d91a4 req-6a67c848-6cda-45e5-92b6-5ed922f6624b service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:35.836122 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-1c14fda5-0e56-4050-a743-aff1b57d91a4 req-6a67c848-6cda-45e5-92b6-5ed922f6624b service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:35.852868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-1c14fda5-0e56-4050-a743-aff1b57d91a4 req-6a67c848-6cda-45e5-92b6-5ed922f6624b service nova] Creating event network-vif-plugged:b5526f44-d0dc-4158-98ba-041cc793f4d7 for instance 16044770-064c-404f-9a5e-c3c493e8a869 on hv-cinder-85600 Sep 06 04:39:35.859384 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-1c14fda5-0e56-4050-a743-aff1b57d91a4 req-6a67c848-6cda-45e5-92b6-5ed922f6624b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039263 Sep 06 04:39:35.860767 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 227/434] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:39:35.890260 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3fa9fd63-90e4-48c0-8cbb-4e12d0bff029 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:35.898303 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3fa9fd63-90e4-48c0-8cbb-4e12d0bff029 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.233729 Sep 06 04:39:35.898874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 208/435] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:35 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:35.954287 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1c196070-dfdf-4c4d-a6d5-cc35c934892f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:35.955128 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1c196070-dfdf-4c4d-a6d5-cc35c934892f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:35.962441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c196070-dfdf-4c4d-a6d5-cc35c934892f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:35.963121 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c196070-dfdf-4c4d-a6d5-cc35c934892f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:35.963735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c196070-dfdf-4c4d-a6d5-cc35c934892f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:35.964427 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c196070-dfdf-4c4d-a6d5-cc35c934892f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:35.965057 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c196070-dfdf-4c4d-a6d5-cc35c934892f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:35.966203 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1c196070-dfdf-4c4d-a6d5-cc35c934892f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:36.186344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1c196070-dfdf-4c4d-a6d5-cc35c934892f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:36.194389 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1c196070-dfdf-4c4d-a6d5-cc35c934892f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:36.195814 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1c196070-dfdf-4c4d-a6d5-cc35c934892f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:36.197035 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1c196070-dfdf-4c4d-a6d5-cc35c934892f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.251142 Sep 06 04:39:36.197622 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 228/436] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:35 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:36.826382 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c9c9c4b6-a533-4859-9bc7-8dc19a2fd978 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:36.826964 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c9c9c4b6-a533-4859-9bc7-8dc19a2fd978 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:36.832981 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9c9c4b6-a533-4859-9bc7-8dc19a2fd978 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:36.833483 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9c9c4b6-a533-4859-9bc7-8dc19a2fd978 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:36.833911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9c9c4b6-a533-4859-9bc7-8dc19a2fd978 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:36.834587 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9c9c4b6-a533-4859-9bc7-8dc19a2fd978 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:36.835031 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9c9c4b6-a533-4859-9bc7-8dc19a2fd978 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:36.835443 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9c9c4b6-a533-4859-9bc7-8dc19a2fd978 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:36.923067 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8ea2d752-f17a-4326-b341-d76da7f893a1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:36.924488 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8ea2d752-f17a-4326-b341-d76da7f893a1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:36.931293 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ea2d752-f17a-4326-b341-d76da7f893a1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:36.931874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ea2d752-f17a-4326-b341-d76da7f893a1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:36.932383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ea2d752-f17a-4326-b341-d76da7f893a1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:36.933150 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ea2d752-f17a-4326-b341-d76da7f893a1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:36.933707 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ea2d752-f17a-4326-b341-d76da7f893a1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:36.935375 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ea2d752-f17a-4326-b341-d76da7f893a1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:36.980270 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c9c9c4b6-a533-4859-9bc7-8dc19a2fd978 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:36.988655 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c9c9c4b6-a533-4859-9bc7-8dc19a2fd978 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1271 microversion: 2.1 time: 0.166160 Sep 06 04:39:36.989224 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 209/437] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:36 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1271 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:37.109642 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8ea2d752-f17a-4326-b341-d76da7f893a1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:37.117154 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8ea2d752-f17a-4326-b341-d76da7f893a1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.199595 Sep 06 04:39:37.125333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 229/438] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:36 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:37.222505 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-289d6c67-18fd-4fa4-a71e-b2fba27b3e3f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:37.223326 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-289d6c67-18fd-4fa4-a71e-b2fba27b3e3f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:37.229140 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-289d6c67-18fd-4fa4-a71e-b2fba27b3e3f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:37.229713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-289d6c67-18fd-4fa4-a71e-b2fba27b3e3f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:37.230142 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-289d6c67-18fd-4fa4-a71e-b2fba27b3e3f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:37.230837 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-289d6c67-18fd-4fa4-a71e-b2fba27b3e3f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:37.231293 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-289d6c67-18fd-4fa4-a71e-b2fba27b3e3f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:37.231703 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-289d6c67-18fd-4fa4-a71e-b2fba27b3e3f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:37.360622 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-289d6c67-18fd-4fa4-a71e-b2fba27b3e3f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:37.371768 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-289d6c67-18fd-4fa4-a71e-b2fba27b3e3f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:37.373359 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-289d6c67-18fd-4fa4-a71e-b2fba27b3e3f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:37.374831 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-289d6c67-18fd-4fa4-a71e-b2fba27b3e3f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.156218 Sep 06 04:39:37.375481 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 210/439] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:37 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:37.468188 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-fc6bdbdc-aa62-47f2-ac72-8c2d58d3f013 req-927faf50-2270-492b-add7-6e4753d41fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddad572e-12e1-4699-ba46-16c1ccb25704", "tag": "784c9a84-7d0f-461b-810d-b0f2b91e1d43"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:39:37.473249 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:39:37.473939 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:39:37.479140 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-fc6bdbdc-aa62-47f2-ac72-8c2d58d3f013 req-927faf50-2270-492b-add7-6e4753d41fe6 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:37.479609 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-fc6bdbdc-aa62-47f2-ac72-8c2d58d3f013 req-927faf50-2270-492b-add7-6e4753d41fe6 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:37.480027 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-fc6bdbdc-aa62-47f2-ac72-8c2d58d3f013 req-927faf50-2270-492b-add7-6e4753d41fe6 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:37.489274 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=14 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:39:37.491589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-fc6bdbdc-aa62-47f2-ac72-8c2d58d3f013 req-927faf50-2270-492b-add7-6e4753d41fe6 service nova] Creating event network-changed:784c9a84-7d0f-461b-810d-b0f2b91e1d43 for instance ddad572e-12e1-4699-ba46-16c1ccb25704 on hv-cinder-85600 Sep 06 04:39:37.496308 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-fc6bdbdc-aa62-47f2-ac72-8c2d58d3f013 req-927faf50-2270-492b-add7-6e4753d41fe6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033168 Sep 06 04:39:37.496918 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 230/440] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:39:38.011056 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9d185d40-1875-436b-9dfa-e562eca29de8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:38.011660 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9d185d40-1875-436b-9dfa-e562eca29de8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:38.015168 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:39:38.019906 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d185d40-1875-436b-9dfa-e562eca29de8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:38.020410 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d185d40-1875-436b-9dfa-e562eca29de8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:38.020841 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d185d40-1875-436b-9dfa-e562eca29de8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:38.021559 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d185d40-1875-436b-9dfa-e562eca29de8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:38.022033 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d185d40-1875-436b-9dfa-e562eca29de8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:38.022451 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9d185d40-1875-436b-9dfa-e562eca29de8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:38.142918 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7db44add-b304-40c4-a3c7-bc81779f48e8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:38.143619 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7db44add-b304-40c4-a3c7-bc81779f48e8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:38.150997 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7db44add-b304-40c4-a3c7-bc81779f48e8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:38.151745 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7db44add-b304-40c4-a3c7-bc81779f48e8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:38.152178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7db44add-b304-40c4-a3c7-bc81779f48e8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:38.152948 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7db44add-b304-40c4-a3c7-bc81779f48e8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:38.153507 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7db44add-b304-40c4-a3c7-bc81779f48e8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:38.158817 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7db44add-b304-40c4-a3c7-bc81779f48e8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:38.159083 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9d185d40-1875-436b-9dfa-e562eca29de8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:38.164030 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9d185d40-1875-436b-9dfa-e562eca29de8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1271 microversion: 2.1 time: 0.156787 Sep 06 04:39:38.164602 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 211/441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:38 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:38.169071 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:39:38.281656 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7db44add-b304-40c4-a3c7-bc81779f48e8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:38.289341 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7db44add-b304-40c4-a3c7-bc81779f48e8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.152265 Sep 06 04:39:38.289886 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 231/442] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:38 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:38.401880 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dacf7863-41e6-46ad-86fc-9f3d6712fb24 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:38.402479 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dacf7863-41e6-46ad-86fc-9f3d6712fb24 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:38.408397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dacf7863-41e6-46ad-86fc-9f3d6712fb24 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:38.408867 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dacf7863-41e6-46ad-86fc-9f3d6712fb24 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:38.409294 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dacf7863-41e6-46ad-86fc-9f3d6712fb24 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:38.409993 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dacf7863-41e6-46ad-86fc-9f3d6712fb24 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:38.410435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dacf7863-41e6-46ad-86fc-9f3d6712fb24 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:38.410847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dacf7863-41e6-46ad-86fc-9f3d6712fb24 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:38.537028 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dacf7863-41e6-46ad-86fc-9f3d6712fb24 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:38.546001 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dacf7863-41e6-46ad-86fc-9f3d6712fb24 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:38.547430 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dacf7863-41e6-46ad-86fc-9f3d6712fb24 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:38.548572 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dacf7863-41e6-46ad-86fc-9f3d6712fb24 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.150820 Sep 06 04:39:38.549151 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 212/443] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:38 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:39.186690 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-65bee4cb-adef-4a87-bcf3-a36170cff3b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:39.187291 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-65bee4cb-adef-4a87-bcf3-a36170cff3b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:39.193750 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65bee4cb-adef-4a87-bcf3-a36170cff3b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:39.194224 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65bee4cb-adef-4a87-bcf3-a36170cff3b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:39.194649 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65bee4cb-adef-4a87-bcf3-a36170cff3b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:39.195318 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65bee4cb-adef-4a87-bcf3-a36170cff3b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:39.195765 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65bee4cb-adef-4a87-bcf3-a36170cff3b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:39.196179 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-65bee4cb-adef-4a87-bcf3-a36170cff3b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:39.312132 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e7303990-e4ee-4d33-8319-7445288285b8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:39.312766 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e7303990-e4ee-4d33-8319-7445288285b8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:39.319148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7303990-e4ee-4d33-8319-7445288285b8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:39.319625 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7303990-e4ee-4d33-8319-7445288285b8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:39.320049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7303990-e4ee-4d33-8319-7445288285b8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:39.320725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7303990-e4ee-4d33-8319-7445288285b8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:39.321167 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7303990-e4ee-4d33-8319-7445288285b8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:39.321602 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7303990-e4ee-4d33-8319-7445288285b8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:39.329112 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-65bee4cb-adef-4a87-bcf3-a36170cff3b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:39.336531 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-65bee4cb-adef-4a87-bcf3-a36170cff3b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1271 microversion: 2.1 time: 0.153854 Sep 06 04:39:39.337094 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 232/444] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:39 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1271 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:39.451901 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e7303990-e4ee-4d33-8319-7445288285b8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:39.459997 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e7303990-e4ee-4d33-8319-7445288285b8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.151819 Sep 06 04:39:39.460557 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 213/445] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:39 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:39.574106 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4d686f89-57cd-4eed-b170-e28a1568450c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:39.574710 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4d686f89-57cd-4eed-b170-e28a1568450c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:39.580856 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d686f89-57cd-4eed-b170-e28a1568450c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:39.581369 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d686f89-57cd-4eed-b170-e28a1568450c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:39.581818 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d686f89-57cd-4eed-b170-e28a1568450c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:39.582503 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d686f89-57cd-4eed-b170-e28a1568450c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:39.582959 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d686f89-57cd-4eed-b170-e28a1568450c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:39.583384 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4d686f89-57cd-4eed-b170-e28a1568450c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:39.711983 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4d686f89-57cd-4eed-b170-e28a1568450c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:39.720171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4d686f89-57cd-4eed-b170-e28a1568450c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:39.721627 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4d686f89-57cd-4eed-b170-e28a1568450c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:39.722769 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4d686f89-57cd-4eed-b170-e28a1568450c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.152576 Sep 06 04:39:39.723325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 233/446] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:39 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:40.360734 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2a1ad557-0e24-4513-a97d-6c6db94a28b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:40.361367 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2a1ad557-0e24-4513-a97d-6c6db94a28b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:40.367884 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a1ad557-0e24-4513-a97d-6c6db94a28b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:40.368328 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a1ad557-0e24-4513-a97d-6c6db94a28b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:40.368755 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a1ad557-0e24-4513-a97d-6c6db94a28b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:40.369468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a1ad557-0e24-4513-a97d-6c6db94a28b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:40.369915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a1ad557-0e24-4513-a97d-6c6db94a28b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:40.370328 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a1ad557-0e24-4513-a97d-6c6db94a28b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:40.483029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4aebd6ed-b1e0-48fa-bab2-19f1d914c740 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:40.483648 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4aebd6ed-b1e0-48fa-bab2-19f1d914c740 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:40.490108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4aebd6ed-b1e0-48fa-bab2-19f1d914c740 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:40.493831 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4aebd6ed-b1e0-48fa-bab2-19f1d914c740 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:40.493831 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4aebd6ed-b1e0-48fa-bab2-19f1d914c740 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:40.493831 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4aebd6ed-b1e0-48fa-bab2-19f1d914c740 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:40.493831 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4aebd6ed-b1e0-48fa-bab2-19f1d914c740 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:40.494199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4aebd6ed-b1e0-48fa-bab2-19f1d914c740 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:40.501859 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2a1ad557-0e24-4513-a97d-6c6db94a28b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:40.504275 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:39:40.512617 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2a1ad557-0e24-4513-a97d-6c6db94a28b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1271 microversion: 2.1 time: 0.155881 Sep 06 04:39:40.513810 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 214/447] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:40 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:40.631839 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4aebd6ed-b1e0-48fa-bab2-19f1d914c740 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:40.635171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4aebd6ed-b1e0-48fa-bab2-19f1d914c740 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.156060 Sep 06 04:39:40.635727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 234/448] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:40 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:40.750352 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f29d2fac-df41-4802-9f6e-be1698085230 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:40.750950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f29d2fac-df41-4802-9f6e-be1698085230 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:40.756875 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f29d2fac-df41-4802-9f6e-be1698085230 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:40.757381 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f29d2fac-df41-4802-9f6e-be1698085230 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:40.757812 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f29d2fac-df41-4802-9f6e-be1698085230 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:40.758493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f29d2fac-df41-4802-9f6e-be1698085230 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:40.758939 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f29d2fac-df41-4802-9f6e-be1698085230 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:40.759359 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f29d2fac-df41-4802-9f6e-be1698085230 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:40.883422 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f29d2fac-df41-4802-9f6e-be1698085230 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:40.892046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f29d2fac-df41-4802-9f6e-be1698085230 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:40.893489 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f29d2fac-df41-4802-9f6e-be1698085230 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:40.894624 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f29d2fac-df41-4802-9f6e-be1698085230 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.149557 Sep 06 04:39:40.895167 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 215/449] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:40 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:41.538411 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3a5eaebe-cabf-4315-b518-509efbf24d31 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:41.539014 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3a5eaebe-cabf-4315-b518-509efbf24d31 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:41.546295 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a5eaebe-cabf-4315-b518-509efbf24d31 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:41.546854 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a5eaebe-cabf-4315-b518-509efbf24d31 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:41.547292 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a5eaebe-cabf-4315-b518-509efbf24d31 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:41.547970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a5eaebe-cabf-4315-b518-509efbf24d31 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:41.548426 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a5eaebe-cabf-4315-b518-509efbf24d31 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:41.548842 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a5eaebe-cabf-4315-b518-509efbf24d31 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:41.659285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5cf9c4da-084a-4eef-9aa9-4e65fcc6cbf0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:41.659933 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5cf9c4da-084a-4eef-9aa9-4e65fcc6cbf0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:41.662337 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:39:41.666930 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cf9c4da-084a-4eef-9aa9-4e65fcc6cbf0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:41.667412 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cf9c4da-084a-4eef-9aa9-4e65fcc6cbf0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:41.667847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cf9c4da-084a-4eef-9aa9-4e65fcc6cbf0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:41.669163 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cf9c4da-084a-4eef-9aa9-4e65fcc6cbf0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:41.669657 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cf9c4da-084a-4eef-9aa9-4e65fcc6cbf0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:41.670138 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cf9c4da-084a-4eef-9aa9-4e65fcc6cbf0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:41.681219 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3a5eaebe-cabf-4315-b518-509efbf24d31 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:41.689689 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3a5eaebe-cabf-4315-b518-509efbf24d31 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1271 microversion: 2.1 time: 0.155099 Sep 06 04:39:41.690253 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 235/450] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:41 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:41.800098 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5cf9c4da-084a-4eef-9aa9-4e65fcc6cbf0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:41.807672 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5cf9c4da-084a-4eef-9aa9-4e65fcc6cbf0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.152459 Sep 06 04:39:41.808232 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 216/451] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:41 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:41.922287 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8715a672-a47f-4fe2-a246-adb3a0f07d4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:41.922810 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8715a672-a47f-4fe2-a246-adb3a0f07d4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:41.928687 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8715a672-a47f-4fe2-a246-adb3a0f07d4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:41.929165 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8715a672-a47f-4fe2-a246-adb3a0f07d4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:41.929628 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8715a672-a47f-4fe2-a246-adb3a0f07d4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:41.930307 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8715a672-a47f-4fe2-a246-adb3a0f07d4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:41.930758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8715a672-a47f-4fe2-a246-adb3a0f07d4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:41.931175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8715a672-a47f-4fe2-a246-adb3a0f07d4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:42.064444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8715a672-a47f-4fe2-a246-adb3a0f07d4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:42.072863 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8715a672-a47f-4fe2-a246-adb3a0f07d4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:42.074593 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8715a672-a47f-4fe2-a246-adb3a0f07d4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:42.075829 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8715a672-a47f-4fe2-a246-adb3a0f07d4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.160067 Sep 06 04:39:42.076375 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 236/452] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:41 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:42.712672 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8b78ad1c-4264-4c70-ae3f-d8f2a5297a83 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:42.713280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8b78ad1c-4264-4c70-ae3f-d8f2a5297a83 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:42.720590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b78ad1c-4264-4c70-ae3f-d8f2a5297a83 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:42.721125 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b78ad1c-4264-4c70-ae3f-d8f2a5297a83 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:42.721591 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b78ad1c-4264-4c70-ae3f-d8f2a5297a83 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:42.722305 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b78ad1c-4264-4c70-ae3f-d8f2a5297a83 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:42.722759 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b78ad1c-4264-4c70-ae3f-d8f2a5297a83 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:42.723181 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b78ad1c-4264-4c70-ae3f-d8f2a5297a83 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:42.831269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8af07366-7f9d-41e4-8707-8891904ddfe0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:42.831970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8af07366-7f9d-41e4-8707-8891904ddfe0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:42.838358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8af07366-7f9d-41e4-8707-8891904ddfe0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:42.838820 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8af07366-7f9d-41e4-8707-8891904ddfe0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:42.839277 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8af07366-7f9d-41e4-8707-8891904ddfe0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:42.839961 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8af07366-7f9d-41e4-8707-8891904ddfe0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:42.841221 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8af07366-7f9d-41e4-8707-8891904ddfe0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:42.841692 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8af07366-7f9d-41e4-8707-8891904ddfe0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:42.858999 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8b78ad1c-4264-4c70-ae3f-d8f2a5297a83 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:42.866831 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8b78ad1c-4264-4c70-ae3f-d8f2a5297a83 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1271 microversion: 2.1 time: 0.158155 Sep 06 04:39:42.873249 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 217/453] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:42 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:42.976926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8af07366-7f9d-41e4-8707-8891904ddfe0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:42.986246 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8af07366-7f9d-41e4-8707-8891904ddfe0 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.158719 Sep 06 04:39:42.986834 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 237/454] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:42 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:43.101700 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6aeec915-35d2-43c3-a009-e2d0c3be5412 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:43.102299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6aeec915-35d2-43c3-a009-e2d0c3be5412 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:43.109031 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6aeec915-35d2-43c3-a009-e2d0c3be5412 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:43.109544 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6aeec915-35d2-43c3-a009-e2d0c3be5412 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:43.109985 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6aeec915-35d2-43c3-a009-e2d0c3be5412 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:43.110694 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6aeec915-35d2-43c3-a009-e2d0c3be5412 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:43.111139 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6aeec915-35d2-43c3-a009-e2d0c3be5412 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:43.111555 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6aeec915-35d2-43c3-a009-e2d0c3be5412 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:43.236069 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6aeec915-35d2-43c3-a009-e2d0c3be5412 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:43.244175 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6aeec915-35d2-43c3-a009-e2d0c3be5412 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:43.245627 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6aeec915-35d2-43c3-a009-e2d0c3be5412 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:43.246835 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6aeec915-35d2-43c3-a009-e2d0c3be5412 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.149010 Sep 06 04:39:43.247392 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 218/455] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:43 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:43.891850 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2f5f3c7a-22e1-4bc1-98b8-00155a78a0da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:43.892274 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2f5f3c7a-22e1-4bc1-98b8-00155a78a0da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:43.899104 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f5f3c7a-22e1-4bc1-98b8-00155a78a0da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:43.899840 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f5f3c7a-22e1-4bc1-98b8-00155a78a0da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:43.900529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f5f3c7a-22e1-4bc1-98b8-00155a78a0da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:43.901523 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f5f3c7a-22e1-4bc1-98b8-00155a78a0da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:43.901995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f5f3c7a-22e1-4bc1-98b8-00155a78a0da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:43.902417 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2f5f3c7a-22e1-4bc1-98b8-00155a78a0da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:44.010872 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5e59bd4c-61c5-4992-b550-d394f9718468 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:44.012061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5e59bd4c-61c5-4992-b550-d394f9718468 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:44.025047 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e59bd4c-61c5-4992-b550-d394f9718468 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:44.029384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e59bd4c-61c5-4992-b550-d394f9718468 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:44.029890 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e59bd4c-61c5-4992-b550-d394f9718468 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:44.030721 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e59bd4c-61c5-4992-b550-d394f9718468 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:44.031182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e59bd4c-61c5-4992-b550-d394f9718468 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:44.031612 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5e59bd4c-61c5-4992-b550-d394f9718468 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:44.076896 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2f5f3c7a-22e1-4bc1-98b8-00155a78a0da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:44.086426 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2f5f3c7a-22e1-4bc1-98b8-00155a78a0da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1271 microversion: 2.1 time: 0.200396 Sep 06 04:39:44.087078 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 238/456] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:43 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:44.177913 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5e59bd4c-61c5-4992-b550-d394f9718468 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:44.185672 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5e59bd4c-61c5-4992-b550-d394f9718468 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.179713 Sep 06 04:39:44.186226 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 219/457] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:44 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:44.272265 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2802ed25-4b3d-4cd3-ac6b-a81b51c8d807 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:44.272785 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2802ed25-4b3d-4cd3-ac6b-a81b51c8d807 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:44.280261 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2802ed25-4b3d-4cd3-ac6b-a81b51c8d807 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:44.280753 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2802ed25-4b3d-4cd3-ac6b-a81b51c8d807 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:44.281192 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2802ed25-4b3d-4cd3-ac6b-a81b51c8d807 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:44.281961 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2802ed25-4b3d-4cd3-ac6b-a81b51c8d807 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:44.282423 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2802ed25-4b3d-4cd3-ac6b-a81b51c8d807 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:44.282848 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2802ed25-4b3d-4cd3-ac6b-a81b51c8d807 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:44.411764 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2802ed25-4b3d-4cd3-ac6b-a81b51c8d807 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:44.419756 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2802ed25-4b3d-4cd3-ac6b-a81b51c8d807 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:44.421236 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2802ed25-4b3d-4cd3-ac6b-a81b51c8d807 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:44.422505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2802ed25-4b3d-4cd3-ac6b-a81b51c8d807 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.154710 Sep 06 04:39:44.423060 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 239/458] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:44 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:45.110473 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-381e1bac-5c4b-41a9-b4d6-48954f445dc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:45.111077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-381e1bac-5c4b-41a9-b4d6-48954f445dc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:45.117449 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-381e1bac-5c4b-41a9-b4d6-48954f445dc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:45.117925 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-381e1bac-5c4b-41a9-b4d6-48954f445dc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:45.118353 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-381e1bac-5c4b-41a9-b4d6-48954f445dc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:45.119022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-381e1bac-5c4b-41a9-b4d6-48954f445dc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:45.119467 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-381e1bac-5c4b-41a9-b4d6-48954f445dc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:45.119879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-381e1bac-5c4b-41a9-b4d6-48954f445dc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:45.209747 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e9acf12a-a576-4101-95b3-a77ed1ef5279 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:45.210612 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e9acf12a-a576-4101-95b3-a77ed1ef5279 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:45.217469 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9acf12a-a576-4101-95b3-a77ed1ef5279 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:45.218037 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9acf12a-a576-4101-95b3-a77ed1ef5279 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:45.218551 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9acf12a-a576-4101-95b3-a77ed1ef5279 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:45.219320 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9acf12a-a576-4101-95b3-a77ed1ef5279 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:45.219780 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9acf12a-a576-4101-95b3-a77ed1ef5279 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:45.220203 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9acf12a-a576-4101-95b3-a77ed1ef5279 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:45.253212 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-381e1bac-5c4b-41a9-b4d6-48954f445dc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:45.261087 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-381e1bac-5c4b-41a9-b4d6-48954f445dc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.155049 Sep 06 04:39:45.262638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 220/459] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:45 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:45.350336 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e9acf12a-a576-4101-95b3-a77ed1ef5279 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:45.358786 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e9acf12a-a576-4101-95b3-a77ed1ef5279 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.154527 Sep 06 04:39:45.359343 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 240/460] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:45 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:45.447445 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6cdc4de9-cc4b-47e2-a2ac-10dc58d0b770 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:45.448044 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6cdc4de9-cc4b-47e2-a2ac-10dc58d0b770 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:45.454067 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6cdc4de9-cc4b-47e2-a2ac-10dc58d0b770 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:45.454544 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6cdc4de9-cc4b-47e2-a2ac-10dc58d0b770 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:45.454971 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6cdc4de9-cc4b-47e2-a2ac-10dc58d0b770 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:45.455643 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6cdc4de9-cc4b-47e2-a2ac-10dc58d0b770 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:45.456085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6cdc4de9-cc4b-47e2-a2ac-10dc58d0b770 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:45.456504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6cdc4de9-cc4b-47e2-a2ac-10dc58d0b770 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:45.588359 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6cdc4de9-cc4b-47e2-a2ac-10dc58d0b770 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:45.597075 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6cdc4de9-cc4b-47e2-a2ac-10dc58d0b770 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:45.598562 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6cdc4de9-cc4b-47e2-a2ac-10dc58d0b770 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:45.599699 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6cdc4de9-cc4b-47e2-a2ac-10dc58d0b770 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.156101 Sep 06 04:39:45.600248 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 221/461] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:45 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:46.284287 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-804daf80-0f54-442e-909c-f1be94def5ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:46.284899 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-804daf80-0f54-442e-909c-f1be94def5ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:46.291665 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-804daf80-0f54-442e-909c-f1be94def5ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:46.292150 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-804daf80-0f54-442e-909c-f1be94def5ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:46.292589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-804daf80-0f54-442e-909c-f1be94def5ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:46.293282 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-804daf80-0f54-442e-909c-f1be94def5ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:46.294419 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-804daf80-0f54-442e-909c-f1be94def5ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:46.294848 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-804daf80-0f54-442e-909c-f1be94def5ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:46.381287 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b15ee156-5e19-4674-9153-8a5e3df5c86b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:46.388345 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b15ee156-5e19-4674-9153-8a5e3df5c86b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:46.389012 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b15ee156-5e19-4674-9153-8a5e3df5c86b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:46.389472 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b15ee156-5e19-4674-9153-8a5e3df5c86b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:46.389932 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b15ee156-5e19-4674-9153-8a5e3df5c86b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:46.390625 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b15ee156-5e19-4674-9153-8a5e3df5c86b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:46.391072 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b15ee156-5e19-4674-9153-8a5e3df5c86b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:46.391486 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b15ee156-5e19-4674-9153-8a5e3df5c86b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:46.429962 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-804daf80-0f54-442e-909c-f1be94def5ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:46.438045 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-804daf80-0f54-442e-909c-f1be94def5ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.157579 Sep 06 04:39:46.438618 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 241/462] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:46 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:46.517495 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b15ee156-5e19-4674-9153-8a5e3df5c86b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:46.525027 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b15ee156-5e19-4674-9153-8a5e3df5c86b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1368 microversion: 2.1 time: 0.147639 Sep 06 04:39:46.525605 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 222/463] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:46 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:46.625110 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-db7868ec-cfde-4466-9e96-b4ae88566a26 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:46.630410 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-db7868ec-cfde-4466-9e96-b4ae88566a26 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:46.631572 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db7868ec-cfde-4466-9e96-b4ae88566a26 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:46.632045 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db7868ec-cfde-4466-9e96-b4ae88566a26 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:46.632474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db7868ec-cfde-4466-9e96-b4ae88566a26 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:46.633144 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db7868ec-cfde-4466-9e96-b4ae88566a26 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:46.633622 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db7868ec-cfde-4466-9e96-b4ae88566a26 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:46.634036 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db7868ec-cfde-4466-9e96-b4ae88566a26 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:46.764834 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-db7868ec-cfde-4466-9e96-b4ae88566a26 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:46.772905 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-db7868ec-cfde-4466-9e96-b4ae88566a26 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:46.774364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-db7868ec-cfde-4466-9e96-b4ae88566a26 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:46.775496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-db7868ec-cfde-4466-9e96-b4ae88566a26 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.154957 Sep 06 04:39:46.776048 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 242/464] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:46 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:47.461337 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5f5ad9e8-8acb-4581-a314-9154fe4790f8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:47.461941 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5f5ad9e8-8acb-4581-a314-9154fe4790f8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:47.467797 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f5ad9e8-8acb-4581-a314-9154fe4790f8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:47.468270 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f5ad9e8-8acb-4581-a314-9154fe4790f8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:47.468694 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f5ad9e8-8acb-4581-a314-9154fe4790f8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:47.469399 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f5ad9e8-8acb-4581-a314-9154fe4790f8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:47.469847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f5ad9e8-8acb-4581-a314-9154fe4790f8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:47.470255 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f5ad9e8-8acb-4581-a314-9154fe4790f8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:47.547844 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4030866e-785c-4d85-acad-dab09b92e1a8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:47.548449 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4030866e-785c-4d85-acad-dab09b92e1a8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:47.555190 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4030866e-785c-4d85-acad-dab09b92e1a8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:47.555670 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4030866e-785c-4d85-acad-dab09b92e1a8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:47.556099 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4030866e-785c-4d85-acad-dab09b92e1a8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:47.556787 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4030866e-785c-4d85-acad-dab09b92e1a8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:47.557273 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4030866e-785c-4d85-acad-dab09b92e1a8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:47.557726 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4030866e-785c-4d85-acad-dab09b92e1a8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:47.603041 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5f5ad9e8-8acb-4581-a314-9154fe4790f8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:47.611901 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5f5ad9e8-8acb-4581-a314-9154fe4790f8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.154468 Sep 06 04:39:47.612675 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 223/465] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:47 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:47.689014 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4030866e-785c-4d85-acad-dab09b92e1a8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:47.696611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4030866e-785c-4d85-acad-dab09b92e1a8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1558 microversion: 2.1 time: 0.153120 Sep 06 04:39:47.697169 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 243/466] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:47 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:47.719032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b83c8f9b-7e3f-4270-a5fe-f3d4c43cf0a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:47.719523 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b83c8f9b-7e3f-4270-a5fe-f3d4c43cf0a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:47.725656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b83c8f9b-7e3f-4270-a5fe-f3d4c43cf0a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:47.726146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b83c8f9b-7e3f-4270-a5fe-f3d4c43cf0a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:47.726614 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b83c8f9b-7e3f-4270-a5fe-f3d4c43cf0a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:47.727386 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b83c8f9b-7e3f-4270-a5fe-f3d4c43cf0a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:47.727855 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b83c8f9b-7e3f-4270-a5fe-f3d4c43cf0a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:47.728162 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b83c8f9b-7e3f-4270-a5fe-f3d4c43cf0a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:47.800982 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6582bd16-8941-4de4-a219-ba003045ed30 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:47.801606 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6582bd16-8941-4de4-a219-ba003045ed30 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:47.804822 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b83c8f9b-7e3f-4270-a5fe-f3d4c43cf0a6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090186 Sep 06 04:39:47.805611 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 224/467] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Sep 6 04:39:47 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:39:47.807578 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6582bd16-8941-4de4-a219-ba003045ed30 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:47.808054 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6582bd16-8941-4de4-a219-ba003045ed30 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:47.808479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6582bd16-8941-4de4-a219-ba003045ed30 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:47.809158 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6582bd16-8941-4de4-a219-ba003045ed30 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:47.809632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6582bd16-8941-4de4-a219-ba003045ed30 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:47.810150 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6582bd16-8941-4de4-a219-ba003045ed30 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:48.077275 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6582bd16-8941-4de4-a219-ba003045ed30 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:48.085454 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6582bd16-8941-4de4-a219-ba003045ed30 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:48.086892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6582bd16-8941-4de4-a219-ba003045ed30 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:48.088049 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6582bd16-8941-4de4-a219-ba003045ed30 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.290962 Sep 06 04:39:48.088604 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 244/468] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:47 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:39:48.634914 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f3b166fb-d3f8-424a-9a0c-2f53aa0a66d3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:48.635787 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f3b166fb-d3f8-424a-9a0c-2f53aa0a66d3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:48.643412 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3b166fb-d3f8-424a-9a0c-2f53aa0a66d3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:48.644109 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3b166fb-d3f8-424a-9a0c-2f53aa0a66d3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:48.644826 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3b166fb-d3f8-424a-9a0c-2f53aa0a66d3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:48.645725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3b166fb-d3f8-424a-9a0c-2f53aa0a66d3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:48.646335 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3b166fb-d3f8-424a-9a0c-2f53aa0a66d3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:48.646980 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3b166fb-d3f8-424a-9a0c-2f53aa0a66d3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:48.781241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f3b166fb-d3f8-424a-9a0c-2f53aa0a66d3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:48.789561 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f3b166fb-d3f8-424a-9a0c-2f53aa0a66d3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.158958 Sep 06 04:39:48.790308 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 225/469] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:48 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:48.859818 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-cc03b682-1649-4461-8001-66bc16f2757e req-51aff12c-ba17-4770-a7a1-ea077b25d7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16044770-064c-404f-9a5e-c3c493e8a869", "tag": "b5526f44-d0dc-4158-98ba-041cc793f4d7"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:39:48.869721 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-cc03b682-1649-4461-8001-66bc16f2757e req-51aff12c-ba17-4770-a7a1-ea077b25d7b9 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:48.870193 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-cc03b682-1649-4461-8001-66bc16f2757e req-51aff12c-ba17-4770-a7a1-ea077b25d7b9 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:48.870619 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-cc03b682-1649-4461-8001-66bc16f2757e req-51aff12c-ba17-4770-a7a1-ea077b25d7b9 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:48.883021 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-cc03b682-1649-4461-8001-66bc16f2757e req-51aff12c-ba17-4770-a7a1-ea077b25d7b9 service nova] Creating event network-changed:b5526f44-d0dc-4158-98ba-041cc793f4d7 for instance 16044770-064c-404f-9a5e-c3c493e8a869 on hv-cinder-85600 Sep 06 04:39:48.888507 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-cc03b682-1649-4461-8001-66bc16f2757e req-51aff12c-ba17-4770-a7a1-ea077b25d7b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032693 Sep 06 04:39:48.889107 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 245/470] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:39:49.113522 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-861db5bf-46fb-4b09-b304-077366891e0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:49.114139 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-861db5bf-46fb-4b09-b304-077366891e0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:49.120171 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-861db5bf-46fb-4b09-b304-077366891e0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:49.120652 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-861db5bf-46fb-4b09-b304-077366891e0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:49.121085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-861db5bf-46fb-4b09-b304-077366891e0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:49.121832 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-861db5bf-46fb-4b09-b304-077366891e0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:49.122294 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-861db5bf-46fb-4b09-b304-077366891e0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:49.122716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-861db5bf-46fb-4b09-b304-077366891e0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:49.252134 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-861db5bf-46fb-4b09-b304-077366891e0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:49.260478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-861db5bf-46fb-4b09-b304-077366891e0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:49.261971 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-861db5bf-46fb-4b09-b304-077366891e0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:49.264138 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-861db5bf-46fb-4b09-b304-077366891e0a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1744 microversion: 2.20 time: 0.154441 Sep 06 04:39:49.264696 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 226/471] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:49 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:49.813195 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cf751308-4fbe-49dc-a5c9-8c2e09a0129e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:49.813912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cf751308-4fbe-49dc-a5c9-8c2e09a0129e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:49.820653 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf751308-4fbe-49dc-a5c9-8c2e09a0129e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:49.821130 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf751308-4fbe-49dc-a5c9-8c2e09a0129e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:49.821589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf751308-4fbe-49dc-a5c9-8c2e09a0129e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:49.822474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf751308-4fbe-49dc-a5c9-8c2e09a0129e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:49.823075 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf751308-4fbe-49dc-a5c9-8c2e09a0129e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:49.824275 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf751308-4fbe-49dc-a5c9-8c2e09a0129e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:49.975496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cf751308-4fbe-49dc-a5c9-8c2e09a0129e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:49.987723 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cf751308-4fbe-49dc-a5c9-8c2e09a0129e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.179316 Sep 06 04:39:49.988747 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 246/472] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:49 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:50.289827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-680199ce-31e3-4c56-a39e-51fb36ad65b8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:50.290435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-680199ce-31e3-4c56-a39e-51fb36ad65b8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:50.296993 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-680199ce-31e3-4c56-a39e-51fb36ad65b8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:50.297517 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-680199ce-31e3-4c56-a39e-51fb36ad65b8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:50.297957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-680199ce-31e3-4c56-a39e-51fb36ad65b8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:50.298650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-680199ce-31e3-4c56-a39e-51fb36ad65b8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:50.299103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-680199ce-31e3-4c56-a39e-51fb36ad65b8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:50.299521 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-680199ce-31e3-4c56-a39e-51fb36ad65b8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:50.428236 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-680199ce-31e3-4c56-a39e-51fb36ad65b8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:50.436280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-680199ce-31e3-4c56-a39e-51fb36ad65b8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:50.437752 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-680199ce-31e3-4c56-a39e-51fb36ad65b8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:50.438900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-680199ce-31e3-4c56-a39e-51fb36ad65b8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.153017 Sep 06 04:39:50.439488 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 227/473] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:50 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:51.010623 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ee1f4d20-fb02-4152-bc31-82901b755fe8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:51.011220 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ee1f4d20-fb02-4152-bc31-82901b755fe8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:51.017716 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee1f4d20-fb02-4152-bc31-82901b755fe8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:51.018193 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee1f4d20-fb02-4152-bc31-82901b755fe8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:51.018616 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee1f4d20-fb02-4152-bc31-82901b755fe8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:51.025721 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee1f4d20-fb02-4152-bc31-82901b755fe8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:51.026217 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee1f4d20-fb02-4152-bc31-82901b755fe8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:51.026917 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ee1f4d20-fb02-4152-bc31-82901b755fe8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:51.160686 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ee1f4d20-fb02-4152-bc31-82901b755fe8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:51.169058 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ee1f4d20-fb02-4152-bc31-82901b755fe8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.161574 Sep 06 04:39:51.169598 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 247/474] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:51 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:51.464755 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1e80a1f4-7696-4eba-aeb8-1ff2106722c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:51.465849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1e80a1f4-7696-4eba-aeb8-1ff2106722c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:51.472404 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e80a1f4-7696-4eba-aeb8-1ff2106722c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:51.472893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e80a1f4-7696-4eba-aeb8-1ff2106722c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:51.473354 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e80a1f4-7696-4eba-aeb8-1ff2106722c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:51.474042 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e80a1f4-7696-4eba-aeb8-1ff2106722c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:51.474497 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e80a1f4-7696-4eba-aeb8-1ff2106722c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:51.474918 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e80a1f4-7696-4eba-aeb8-1ff2106722c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:51.599422 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1e80a1f4-7696-4eba-aeb8-1ff2106722c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:51.608019 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1e80a1f4-7696-4eba-aeb8-1ff2106722c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:51.609469 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1e80a1f4-7696-4eba-aeb8-1ff2106722c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:51.610635 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1e80a1f4-7696-4eba-aeb8-1ff2106722c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.149829 Sep 06 04:39:51.611193 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 228/475] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:51 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:52.192028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6a567dc6-772e-414f-935a-cf328fdd1214 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:52.192700 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6a567dc6-772e-414f-935a-cf328fdd1214 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:52.199177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a567dc6-772e-414f-935a-cf328fdd1214 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:52.199637 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a567dc6-772e-414f-935a-cf328fdd1214 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:52.200796 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a567dc6-772e-414f-935a-cf328fdd1214 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:52.201517 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a567dc6-772e-414f-935a-cf328fdd1214 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:52.201964 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a567dc6-772e-414f-935a-cf328fdd1214 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:52.202405 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a567dc6-772e-414f-935a-cf328fdd1214 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:52.335236 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6a567dc6-772e-414f-935a-cf328fdd1214 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:52.337658 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:39:52.344227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6a567dc6-772e-414f-935a-cf328fdd1214 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.156405 Sep 06 04:39:52.344795 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 248/476] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:52 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:39:52.634743 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-523ec990-5798-4bd4-bd36-3b7f0fc52990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:52.635309 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-523ec990-5798-4bd4-bd36-3b7f0fc52990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:52.641601 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-523ec990-5798-4bd4-bd36-3b7f0fc52990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:52.642119 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-523ec990-5798-4bd4-bd36-3b7f0fc52990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:52.642545 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-523ec990-5798-4bd4-bd36-3b7f0fc52990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:52.643220 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-523ec990-5798-4bd4-bd36-3b7f0fc52990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:52.643662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-523ec990-5798-4bd4-bd36-3b7f0fc52990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:52.644076 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-523ec990-5798-4bd4-bd36-3b7f0fc52990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:52.773511 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-523ec990-5798-4bd4-bd36-3b7f0fc52990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:52.782438 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-523ec990-5798-4bd4-bd36-3b7f0fc52990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:52.783863 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-523ec990-5798-4bd4-bd36-3b7f0fc52990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:52.785002 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-523ec990-5798-4bd4-bd36-3b7f0fc52990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.154335 Sep 06 04:39:52.785588 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 229/477] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:52 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:53.369239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-aa96554a-6e5b-43d7-8068-384a130e73c5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:53.369863 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-aa96554a-6e5b-43d7-8068-384a130e73c5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:53.377695 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa96554a-6e5b-43d7-8068-384a130e73c5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:53.378178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa96554a-6e5b-43d7-8068-384a130e73c5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:53.378604 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa96554a-6e5b-43d7-8068-384a130e73c5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:53.379313 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa96554a-6e5b-43d7-8068-384a130e73c5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:53.379760 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa96554a-6e5b-43d7-8068-384a130e73c5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:53.380211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aa96554a-6e5b-43d7-8068-384a130e73c5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:53.510836 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-aa96554a-6e5b-43d7-8068-384a130e73c5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:53.517394 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-aa96554a-6e5b-43d7-8068-384a130e73c5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.152009 Sep 06 04:39:53.517957 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 249/478] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:53 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:53.810104 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4f02f80e-965d-4fec-9155-aba93778d17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:53.810715 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4f02f80e-965d-4fec-9155-aba93778d17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:53.817143 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f02f80e-965d-4fec-9155-aba93778d17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:53.817654 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f02f80e-965d-4fec-9155-aba93778d17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:53.818090 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f02f80e-965d-4fec-9155-aba93778d17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:53.818776 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f02f80e-965d-4fec-9155-aba93778d17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:53.819228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f02f80e-965d-4fec-9155-aba93778d17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:53.819651 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4f02f80e-965d-4fec-9155-aba93778d17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:53.944934 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4f02f80e-965d-4fec-9155-aba93778d17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:53.953737 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4f02f80e-965d-4fec-9155-aba93778d17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:53.955155 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4f02f80e-965d-4fec-9155-aba93778d17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:53.956561 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4f02f80e-965d-4fec-9155-aba93778d17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.150400 Sep 06 04:39:53.957114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 230/479] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:53 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:54.539992 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4f4b0dc4-3b19-4d9a-8715-21c0eadee495 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:54.540519 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4f4b0dc4-3b19-4d9a-8715-21c0eadee495 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:54.547056 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4f4b0dc4-3b19-4d9a-8715-21c0eadee495 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:54.547530 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4f4b0dc4-3b19-4d9a-8715-21c0eadee495 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:54.547955 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4f4b0dc4-3b19-4d9a-8715-21c0eadee495 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:54.548623 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4f4b0dc4-3b19-4d9a-8715-21c0eadee495 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:54.549069 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4f4b0dc4-3b19-4d9a-8715-21c0eadee495 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:54.549519 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4f4b0dc4-3b19-4d9a-8715-21c0eadee495 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:54.682696 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4f4b0dc4-3b19-4d9a-8715-21c0eadee495 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:54.690953 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4f4b0dc4-3b19-4d9a-8715-21c0eadee495 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.154858 Sep 06 04:39:54.691515 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 250/480] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:54 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:54.982468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a25ee896-3efd-4500-bfa9-e5fc1abddd03 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:54.983065 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a25ee896-3efd-4500-bfa9-e5fc1abddd03 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:54.989577 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a25ee896-3efd-4500-bfa9-e5fc1abddd03 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:54.990054 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a25ee896-3efd-4500-bfa9-e5fc1abddd03 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:54.990484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a25ee896-3efd-4500-bfa9-e5fc1abddd03 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:54.991169 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a25ee896-3efd-4500-bfa9-e5fc1abddd03 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:54.991613 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a25ee896-3efd-4500-bfa9-e5fc1abddd03 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:54.992028 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a25ee896-3efd-4500-bfa9-e5fc1abddd03 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:55.126828 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a25ee896-3efd-4500-bfa9-e5fc1abddd03 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:55.128978 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:39:55.135309 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a25ee896-3efd-4500-bfa9-e5fc1abddd03 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:55.136732 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a25ee896-3efd-4500-bfa9-e5fc1abddd03 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:55.138495 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a25ee896-3efd-4500-bfa9-e5fc1abddd03 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.160376 Sep 06 04:39:55.139049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 231/481] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:54 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:55.713334 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d46c9734-80e3-463b-8563-c9029ca1d613 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:55.713958 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d46c9734-80e3-463b-8563-c9029ca1d613 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:55.720335 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d46c9734-80e3-463b-8563-c9029ca1d613 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:55.720820 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d46c9734-80e3-463b-8563-c9029ca1d613 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:55.721254 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d46c9734-80e3-463b-8563-c9029ca1d613 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:55.721967 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d46c9734-80e3-463b-8563-c9029ca1d613 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:55.722421 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d46c9734-80e3-463b-8563-c9029ca1d613 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:55.722845 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d46c9734-80e3-463b-8563-c9029ca1d613 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:55.864397 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d46c9734-80e3-463b-8563-c9029ca1d613 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:55.872596 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d46c9734-80e3-463b-8563-c9029ca1d613 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.162943 Sep 06 04:39:55.873191 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 251/482] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:55 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:56.163281 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-90af35b2-e80d-4401-a4ac-106456db9b01 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:56.164349 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-90af35b2-e80d-4401-a4ac-106456db9b01 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:56.174048 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90af35b2-e80d-4401-a4ac-106456db9b01 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:56.174627 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90af35b2-e80d-4401-a4ac-106456db9b01 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:56.175054 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90af35b2-e80d-4401-a4ac-106456db9b01 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:56.175756 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90af35b2-e80d-4401-a4ac-106456db9b01 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:56.176195 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90af35b2-e80d-4401-a4ac-106456db9b01 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:56.176744 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-90af35b2-e80d-4401-a4ac-106456db9b01 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:56.332582 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-90af35b2-e80d-4401-a4ac-106456db9b01 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:56.342299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-90af35b2-e80d-4401-a4ac-106456db9b01 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:56.343728 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-90af35b2-e80d-4401-a4ac-106456db9b01 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:56.344882 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-90af35b2-e80d-4401-a4ac-106456db9b01 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.185443 Sep 06 04:39:56.345451 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 232/483] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:56 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:39:56.896429 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f3b20680-0630-40f5-837f-8396fbd0c08f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:56.897141 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f3b20680-0630-40f5-837f-8396fbd0c08f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:56.905115 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3b20680-0630-40f5-837f-8396fbd0c08f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:56.905856 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3b20680-0630-40f5-837f-8396fbd0c08f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:56.906509 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3b20680-0630-40f5-837f-8396fbd0c08f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:56.907407 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3b20680-0630-40f5-837f-8396fbd0c08f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:56.908056 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3b20680-0630-40f5-837f-8396fbd0c08f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:56.908698 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f3b20680-0630-40f5-837f-8396fbd0c08f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:57.111236 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f3b20680-0630-40f5-837f-8396fbd0c08f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:57.111236 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f3b20680-0630-40f5-837f-8396fbd0c08f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.201748 Sep 06 04:39:57.111236 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 252/484] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:56 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:57.374200 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c90c5800-8435-4a3d-b944-06ac982f7c58 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:57.374200 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c90c5800-8435-4a3d-b944-06ac982f7c58 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:57.389780 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c90c5800-8435-4a3d-b944-06ac982f7c58 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:57.390648 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c90c5800-8435-4a3d-b944-06ac982f7c58 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:57.391270 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c90c5800-8435-4a3d-b944-06ac982f7c58 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:57.402385 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c90c5800-8435-4a3d-b944-06ac982f7c58 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:57.402385 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c90c5800-8435-4a3d-b944-06ac982f7c58 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:57.402385 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c90c5800-8435-4a3d-b944-06ac982f7c58 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:57.573489 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c90c5800-8435-4a3d-b944-06ac982f7c58 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:57.586896 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c90c5800-8435-4a3d-b944-06ac982f7c58 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:57.588890 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c90c5800-8435-4a3d-b944-06ac982f7c58 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:57.591191 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c90c5800-8435-4a3d-b944-06ac982f7c58 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.223086 Sep 06 04:39:57.592258 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 233/485] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:57 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:58.122221 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f20efcc4-4b35-4e36-93b0-91ad2fc29a5c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:58.122940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f20efcc4-4b35-4e36-93b0-91ad2fc29a5c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:58.136223 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f20efcc4-4b35-4e36-93b0-91ad2fc29a5c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:58.137992 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f20efcc4-4b35-4e36-93b0-91ad2fc29a5c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:58.138580 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f20efcc4-4b35-4e36-93b0-91ad2fc29a5c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:58.139278 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f20efcc4-4b35-4e36-93b0-91ad2fc29a5c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:58.139751 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f20efcc4-4b35-4e36-93b0-91ad2fc29a5c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:58.140214 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f20efcc4-4b35-4e36-93b0-91ad2fc29a5c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:58.308862 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f20efcc4-4b35-4e36-93b0-91ad2fc29a5c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:58.319918 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f20efcc4-4b35-4e36-93b0-91ad2fc29a5c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.201930 Sep 06 04:39:58.320604 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 253/486] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:58 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:58.626217 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-298f56ab-554c-4d43-af6a-be180ff559d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:58.627957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-298f56ab-554c-4d43-af6a-be180ff559d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:58.635588 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-298f56ab-554c-4d43-af6a-be180ff559d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:58.636679 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-298f56ab-554c-4d43-af6a-be180ff559d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:58.638802 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-298f56ab-554c-4d43-af6a-be180ff559d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:58.639750 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-298f56ab-554c-4d43-af6a-be180ff559d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:58.640291 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-298f56ab-554c-4d43-af6a-be180ff559d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:58.640790 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-298f56ab-554c-4d43-af6a-be180ff559d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:58.799071 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-298f56ab-554c-4d43-af6a-be180ff559d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:58.816645 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-298f56ab-554c-4d43-af6a-be180ff559d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:58.818498 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-298f56ab-554c-4d43-af6a-be180ff559d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:58.819948 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-298f56ab-554c-4d43-af6a-be180ff559d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.198797 Sep 06 04:39:58.821146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 234/487] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:58 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:39:59.346636 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fa8b2601-5330-41a1-b4e5-148a32ad8cdd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:59.348049 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fa8b2601-5330-41a1-b4e5-148a32ad8cdd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:59.355124 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa8b2601-5330-41a1-b4e5-148a32ad8cdd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:59.355573 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa8b2601-5330-41a1-b4e5-148a32ad8cdd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:59.356346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa8b2601-5330-41a1-b4e5-148a32ad8cdd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:59.357295 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa8b2601-5330-41a1-b4e5-148a32ad8cdd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:59.357850 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa8b2601-5330-41a1-b4e5-148a32ad8cdd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:59.358358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa8b2601-5330-41a1-b4e5-148a32ad8cdd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:59.529049 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fa8b2601-5330-41a1-b4e5-148a32ad8cdd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:39:59.548843 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fa8b2601-5330-41a1-b4e5-148a32ad8cdd tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.209484 Sep 06 04:39:59.550659 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 254/488] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:39:59 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:39:59.846160 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7183c021-56fc-4a70-ac40-f1a3568a55a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:39:59.847765 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7183c021-56fc-4a70-ac40-f1a3568a55a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:39:59.863054 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7183c021-56fc-4a70-ac40-f1a3568a55a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:59.867472 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7183c021-56fc-4a70-ac40-f1a3568a55a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:59.867472 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7183c021-56fc-4a70-ac40-f1a3568a55a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:39:59.867472 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7183c021-56fc-4a70-ac40-f1a3568a55a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:39:59.867472 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7183c021-56fc-4a70-ac40-f1a3568a55a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:39:59.867873 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7183c021-56fc-4a70-ac40-f1a3568a55a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:00.018369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7183c021-56fc-4a70-ac40-f1a3568a55a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:00.027292 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7183c021-56fc-4a70-ac40-f1a3568a55a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:00.029296 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7183c021-56fc-4a70-ac40-f1a3568a55a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:00.030580 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7183c021-56fc-4a70-ac40-f1a3568a55a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.188227 Sep 06 04:40:00.031320 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 235/489] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:39:59 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:00.076862 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-234d191d-2384-4357-9ca1-9859e0720af3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:00.077264 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-234d191d-2384-4357-9ca1-9859e0720af3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:00.083297 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-234d191d-2384-4357-9ca1-9859e0720af3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:00.083784 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-234d191d-2384-4357-9ca1-9859e0720af3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:00.084246 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-234d191d-2384-4357-9ca1-9859e0720af3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:00.084953 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-234d191d-2384-4357-9ca1-9859e0720af3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:00.085442 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-234d191d-2384-4357-9ca1-9859e0720af3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:00.086046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-234d191d-2384-4357-9ca1-9859e0720af3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:00.240509 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-234d191d-2384-4357-9ca1-9859e0720af3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lazy-loading 'services' on Instance uuid 10d37307-eefc-4b31-b42d-6042e4abee25 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:40:00.558413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-234d191d-2384-4357-9ca1-9859e0720af3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "DELETE /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25/os-volume_attachments/19597a5e-fa13-4d3f-9dc3-646bd45738a2" status: 202 len: 0 microversion: 2.1 time: 0.485501 Sep 06 04:40:00.560261 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 255/490] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Sep 6 04:40:00 2022] DELETE /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25/os-volume_attachments/19597a5e-fa13-4d3f-9dc3-646bd45738a2 => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:40:00.585834 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0100a4a5-d5a7-4fc5-8c5b-9df499c20129 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:00.586901 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0100a4a5-d5a7-4fc5-8c5b-9df499c20129 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:00.609035 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0100a4a5-d5a7-4fc5-8c5b-9df499c20129 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:00.612213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0100a4a5-d5a7-4fc5-8c5b-9df499c20129 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:00.612213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0100a4a5-d5a7-4fc5-8c5b-9df499c20129 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:00.614492 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0100a4a5-d5a7-4fc5-8c5b-9df499c20129 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:00.615513 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0100a4a5-d5a7-4fc5-8c5b-9df499c20129 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:00.617597 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0100a4a5-d5a7-4fc5-8c5b-9df499c20129 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:00.832566 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0100a4a5-d5a7-4fc5-8c5b-9df499c20129 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:00.842271 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0100a4a5-d5a7-4fc5-8c5b-9df499c20129 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.261206 Sep 06 04:40:00.844070 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 236/491] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:00 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:01.060317 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0894b3db-80e0-4e5b-8cbc-e249674b3b90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:01.061797 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0894b3db-80e0-4e5b-8cbc-e249674b3b90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:01.073359 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0894b3db-80e0-4e5b-8cbc-e249674b3b90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:01.074613 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0894b3db-80e0-4e5b-8cbc-e249674b3b90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:01.075850 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0894b3db-80e0-4e5b-8cbc-e249674b3b90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:01.076651 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0894b3db-80e0-4e5b-8cbc-e249674b3b90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:01.077177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0894b3db-80e0-4e5b-8cbc-e249674b3b90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:01.077712 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0894b3db-80e0-4e5b-8cbc-e249674b3b90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:01.239197 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0894b3db-80e0-4e5b-8cbc-e249674b3b90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:01.248935 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0894b3db-80e0-4e5b-8cbc-e249674b3b90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:01.250400 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0894b3db-80e0-4e5b-8cbc-e249674b3b90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:01.251680 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0894b3db-80e0-4e5b-8cbc-e249674b3b90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.197736 Sep 06 04:40:01.252950 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 256/492] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:01 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:01.866263 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eeea09f6-c5e5-40a1-91be-dd8abf8716c0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:01.866887 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-eeea09f6-c5e5-40a1-91be-dd8abf8716c0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:01.874324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeea09f6-c5e5-40a1-91be-dd8abf8716c0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:01.874804 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeea09f6-c5e5-40a1-91be-dd8abf8716c0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:01.875235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeea09f6-c5e5-40a1-91be-dd8abf8716c0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:01.876156 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeea09f6-c5e5-40a1-91be-dd8abf8716c0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:01.876667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeea09f6-c5e5-40a1-91be-dd8abf8716c0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:01.877317 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eeea09f6-c5e5-40a1-91be-dd8abf8716c0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:02.048517 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eeea09f6-c5e5-40a1-91be-dd8abf8716c0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:02.056537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-eeea09f6-c5e5-40a1-91be-dd8abf8716c0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.194093 Sep 06 04:40:02.057105 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 237/493] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:01 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:02.279774 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6d9c71b4-2228-47ef-9fae-05d799e3495f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:02.280964 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6d9c71b4-2228-47ef-9fae-05d799e3495f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:02.288122 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d9c71b4-2228-47ef-9fae-05d799e3495f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:02.288874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d9c71b4-2228-47ef-9fae-05d799e3495f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:02.289433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d9c71b4-2228-47ef-9fae-05d799e3495f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:02.290156 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d9c71b4-2228-47ef-9fae-05d799e3495f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:02.290775 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d9c71b4-2228-47ef-9fae-05d799e3495f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:02.291376 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6d9c71b4-2228-47ef-9fae-05d799e3495f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:02.445830 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6d9c71b4-2228-47ef-9fae-05d799e3495f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:02.455325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6d9c71b4-2228-47ef-9fae-05d799e3495f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:02.457397 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6d9c71b4-2228-47ef-9fae-05d799e3495f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:02.458846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6d9c71b4-2228-47ef-9fae-05d799e3495f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.183767 Sep 06 04:40:02.472580 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 257/494] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:02 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:03.081659 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a7ef45f5-c077-4aaa-ba3b-79bbb7c55498 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:03.082298 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a7ef45f5-c077-4aaa-ba3b-79bbb7c55498 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:03.089186 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7ef45f5-c077-4aaa-ba3b-79bbb7c55498 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:03.089708 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7ef45f5-c077-4aaa-ba3b-79bbb7c55498 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:03.090142 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7ef45f5-c077-4aaa-ba3b-79bbb7c55498 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:03.091114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7ef45f5-c077-4aaa-ba3b-79bbb7c55498 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:03.091712 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7ef45f5-c077-4aaa-ba3b-79bbb7c55498 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:03.092137 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7ef45f5-c077-4aaa-ba3b-79bbb7c55498 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:03.233754 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a7ef45f5-c077-4aaa-ba3b-79bbb7c55498 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:03.241602 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a7ef45f5-c077-4aaa-ba3b-79bbb7c55498 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.164903 Sep 06 04:40:03.242176 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 238/495] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:03 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:03.486859 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4700b104-2ff2-4815-9616-bcfb38c50028 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:03.487487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4700b104-2ff2-4815-9616-bcfb38c50028 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:03.495118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4700b104-2ff2-4815-9616-bcfb38c50028 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:03.495599 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4700b104-2ff2-4815-9616-bcfb38c50028 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:03.496028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4700b104-2ff2-4815-9616-bcfb38c50028 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:03.496719 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4700b104-2ff2-4815-9616-bcfb38c50028 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:03.497521 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4700b104-2ff2-4815-9616-bcfb38c50028 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:03.498029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4700b104-2ff2-4815-9616-bcfb38c50028 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:03.658668 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4700b104-2ff2-4815-9616-bcfb38c50028 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:03.667063 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4700b104-2ff2-4815-9616-bcfb38c50028 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:03.668503 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4700b104-2ff2-4815-9616-bcfb38c50028 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:03.669728 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4700b104-2ff2-4815-9616-bcfb38c50028 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.186738 Sep 06 04:40:03.670294 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 258/496] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:03 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:40:04.266400 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-600eac5f-623c-4eaa-bb6a-58f65a064d84 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:04.267694 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-600eac5f-623c-4eaa-bb6a-58f65a064d84 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:04.282233 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-600eac5f-623c-4eaa-bb6a-58f65a064d84 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:04.282233 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-600eac5f-623c-4eaa-bb6a-58f65a064d84 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:04.282233 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-600eac5f-623c-4eaa-bb6a-58f65a064d84 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:04.282233 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-600eac5f-623c-4eaa-bb6a-58f65a064d84 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:04.282724 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-600eac5f-623c-4eaa-bb6a-58f65a064d84 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:04.282724 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-600eac5f-623c-4eaa-bb6a-58f65a064d84 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:04.432731 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-600eac5f-623c-4eaa-bb6a-58f65a064d84 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:04.447116 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-600eac5f-623c-4eaa-bb6a-58f65a064d84 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.185219 Sep 06 04:40:04.463308 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 239/497] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:04 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:04.696835 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-241a66d7-1db4-4af7-9fed-18449fa1e895 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:04.697640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-241a66d7-1db4-4af7-9fed-18449fa1e895 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:04.710064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-241a66d7-1db4-4af7-9fed-18449fa1e895 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:04.711189 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-241a66d7-1db4-4af7-9fed-18449fa1e895 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:04.711844 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-241a66d7-1db4-4af7-9fed-18449fa1e895 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:04.712872 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-241a66d7-1db4-4af7-9fed-18449fa1e895 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:04.713583 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-241a66d7-1db4-4af7-9fed-18449fa1e895 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:04.714238 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-241a66d7-1db4-4af7-9fed-18449fa1e895 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:04.888078 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-241a66d7-1db4-4af7-9fed-18449fa1e895 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:04.898488 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-241a66d7-1db4-4af7-9fed-18449fa1e895 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:04.899914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-241a66d7-1db4-4af7-9fed-18449fa1e895 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:04.901742 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-241a66d7-1db4-4af7-9fed-18449fa1e895 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.209962 Sep 06 04:40:04.918218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 259/498] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:04 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:05.003118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1e203eda-c0e8-4e58-a616-f4988914a557 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:05.003607 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1e203eda-c0e8-4e58-a616-f4988914a557 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:05.010346 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e203eda-c0e8-4e58-a616-f4988914a557 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:05.011347 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e203eda-c0e8-4e58-a616-f4988914a557 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:05.011776 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e203eda-c0e8-4e58-a616-f4988914a557 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:05.012653 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e203eda-c0e8-4e58-a616-f4988914a557 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:05.013296 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e203eda-c0e8-4e58-a616-f4988914a557 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:05.013739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e203eda-c0e8-4e58-a616-f4988914a557 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:05.043009 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1e203eda-c0e8-4e58-a616-f4988914a557 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:40:05.284441 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1e203eda-c0e8-4e58-a616-f4988914a557 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "DELETE /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 204 len: 0 microversion: 2.1 time: 0.284843 Sep 06 04:40:05.291941 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 240/499] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:40:04 2022] DELETE /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:40:05.298683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-72a264a0-cc80-4d3b-b0a8-f7b679cbf2f2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:05.299291 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-72a264a0-cc80-4d3b-b0a8-f7b679cbf2f2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:05.305689 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72a264a0-cc80-4d3b-b0a8-f7b679cbf2f2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:05.306175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72a264a0-cc80-4d3b-b0a8-f7b679cbf2f2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:05.306603 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72a264a0-cc80-4d3b-b0a8-f7b679cbf2f2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:05.307288 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72a264a0-cc80-4d3b-b0a8-f7b679cbf2f2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:05.307824 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72a264a0-cc80-4d3b-b0a8-f7b679cbf2f2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:05.308571 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-72a264a0-cc80-4d3b-b0a8-f7b679cbf2f2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:05.464147 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-72a264a0-cc80-4d3b-b0a8-f7b679cbf2f2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:05.471551 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c84b9bd2-8cc4-417e-be45-5dec8b363964 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:05.472461 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c84b9bd2-8cc4-417e-be45-5dec8b363964 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:05.478826 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c84b9bd2-8cc4-417e-be45-5dec8b363964 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:05.479308 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c84b9bd2-8cc4-417e-be45-5dec8b363964 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:05.479743 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c84b9bd2-8cc4-417e-be45-5dec8b363964 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:05.480430 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c84b9bd2-8cc4-417e-be45-5dec8b363964 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:05.480610 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-72a264a0-cc80-4d3b-b0a8-f7b679cbf2f2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1512 microversion: 2.1 time: 0.187078 Sep 06 04:40:05.480911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c84b9bd2-8cc4-417e-be45-5dec8b363964 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:05.481335 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c84b9bd2-8cc4-417e-be45-5dec8b363964 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:05.497892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 260/500] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:05 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:05.639527 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c84b9bd2-8cc4-417e-be45-5dec8b363964 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:05.648067 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c84b9bd2-8cc4-417e-be45-5dec8b363964 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.181038 Sep 06 04:40:05.661042 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 241/501] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:05 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:40:05.931328 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8e96acb6-8b48-4bbe-bffb-e5719bd8cae4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:05.933133 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8e96acb6-8b48-4bbe-bffb-e5719bd8cae4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:05.940691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e96acb6-8b48-4bbe-bffb-e5719bd8cae4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:05.941213 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e96acb6-8b48-4bbe-bffb-e5719bd8cae4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:05.941645 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e96acb6-8b48-4bbe-bffb-e5719bd8cae4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:05.942342 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e96acb6-8b48-4bbe-bffb-e5719bd8cae4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:05.945696 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e96acb6-8b48-4bbe-bffb-e5719bd8cae4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:05.946286 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e96acb6-8b48-4bbe-bffb-e5719bd8cae4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:06.098514 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8e96acb6-8b48-4bbe-bffb-e5719bd8cae4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:06.109103 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8e96acb6-8b48-4bbe-bffb-e5719bd8cae4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:06.110556 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8e96acb6-8b48-4bbe-bffb-e5719bd8cae4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:06.111699 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8e96acb6-8b48-4bbe-bffb-e5719bd8cae4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.184917 Sep 06 04:40:06.129902 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 261/502] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:05 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:06.511970 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-77b585c9-a7d1-4914-88b2-4ef611550a44 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:06.512612 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-77b585c9-a7d1-4914-88b2-4ef611550a44 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:06.521224 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77b585c9-a7d1-4914-88b2-4ef611550a44 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:06.521738 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77b585c9-a7d1-4914-88b2-4ef611550a44 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:06.522167 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77b585c9-a7d1-4914-88b2-4ef611550a44 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:06.522917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77b585c9-a7d1-4914-88b2-4ef611550a44 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:06.523343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77b585c9-a7d1-4914-88b2-4ef611550a44 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:06.523757 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-77b585c9-a7d1-4914-88b2-4ef611550a44 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:06.667375 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-77b585c9-a7d1-4914-88b2-4ef611550a44 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:06.673218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0064658e-ac46-426b-8a3e-fbd795942fc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:06.673218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0064658e-ac46-426b-8a3e-fbd795942fc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:06.677417 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-77b585c9-a7d1-4914-88b2-4ef611550a44 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1512 microversion: 2.1 time: 0.169150 Sep 06 04:40:06.677748 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 242/503] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:06 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:06.679118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0064658e-ac46-426b-8a3e-fbd795942fc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:06.679605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0064658e-ac46-426b-8a3e-fbd795942fc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:06.680034 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0064658e-ac46-426b-8a3e-fbd795942fc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:06.680724 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0064658e-ac46-426b-8a3e-fbd795942fc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:06.681165 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0064658e-ac46-426b-8a3e-fbd795942fc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:06.681605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0064658e-ac46-426b-8a3e-fbd795942fc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:06.838720 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0064658e-ac46-426b-8a3e-fbd795942fc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:06.846924 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0064658e-ac46-426b-8a3e-fbd795942fc8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.179445 Sep 06 04:40:06.847481 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 262/504] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:06 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:40:07.131583 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-513bf4e2-436d-46ca-8b1b-96add5275d7a req-6109f310-89fd-43e0-95f8-f2196ba19eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddad572e-12e1-4699-ba46-16c1ccb25704", "name": "network-vif-plugged", "status": "completed", "tag": "784c9a84-7d0f-461b-810d-b0f2b91e1d43"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:40:07.143506 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-84a58a94-660a-4d55-ad34-c4a6a2da944f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:07.148134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-84a58a94-660a-4d55-ad34-c4a6a2da944f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:07.157469 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-513bf4e2-436d-46ca-8b1b-96add5275d7a req-6109f310-89fd-43e0-95f8-f2196ba19eed service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:07.161531 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84a58a94-660a-4d55-ad34-c4a6a2da944f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:07.162124 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84a58a94-660a-4d55-ad34-c4a6a2da944f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:07.162654 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84a58a94-660a-4d55-ad34-c4a6a2da944f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:07.163460 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84a58a94-660a-4d55-ad34-c4a6a2da944f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:07.164019 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84a58a94-660a-4d55-ad34-c4a6a2da944f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:07.164672 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-513bf4e2-436d-46ca-8b1b-96add5275d7a req-6109f310-89fd-43e0-95f8-f2196ba19eed service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:07.165227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-84a58a94-660a-4d55-ad34-c4a6a2da944f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:07.166198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-513bf4e2-436d-46ca-8b1b-96add5275d7a req-6109f310-89fd-43e0-95f8-f2196ba19eed service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:07.185656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-513bf4e2-436d-46ca-8b1b-96add5275d7a req-6109f310-89fd-43e0-95f8-f2196ba19eed service nova] Creating event network-vif-plugged:784c9a84-7d0f-461b-810d-b0f2b91e1d43 for instance ddad572e-12e1-4699-ba46-16c1ccb25704 on hv-cinder-85600 Sep 06 04:40:07.192071 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-513bf4e2-436d-46ca-8b1b-96add5275d7a req-6109f310-89fd-43e0-95f8-f2196ba19eed service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064991 Sep 06 04:40:07.193402 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 243/505] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:40:07.355437 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-84a58a94-660a-4d55-ad34-c4a6a2da944f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:07.365238 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-84a58a94-660a-4d55-ad34-c4a6a2da944f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:07.371840 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-84a58a94-660a-4d55-ad34-c4a6a2da944f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:07.374044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-84a58a94-660a-4d55-ad34-c4a6a2da944f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.234124 Sep 06 04:40:07.375107 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 263/506] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:07 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:07.701891 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c7674180-6ce7-47fd-a7f1-a2359860b9f3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:07.702610 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c7674180-6ce7-47fd-a7f1-a2359860b9f3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:07.709594 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7674180-6ce7-47fd-a7f1-a2359860b9f3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:07.710087 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7674180-6ce7-47fd-a7f1-a2359860b9f3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:07.710562 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7674180-6ce7-47fd-a7f1-a2359860b9f3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:07.711229 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7674180-6ce7-47fd-a7f1-a2359860b9f3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:07.711692 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7674180-6ce7-47fd-a7f1-a2359860b9f3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:07.712123 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7674180-6ce7-47fd-a7f1-a2359860b9f3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:07.858051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c7674180-6ce7-47fd-a7f1-a2359860b9f3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:07.866110 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c7674180-6ce7-47fd-a7f1-a2359860b9f3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1512 microversion: 2.1 time: 0.169412 Sep 06 04:40:07.871703 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-36353cea-d1b8-4770-bb35-50cff351ea44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:07.872347 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-36353cea-d1b8-4770-bb35-50cff351ea44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:07.877741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 244/507] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:07 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:07.881146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36353cea-d1b8-4770-bb35-50cff351ea44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:07.881697 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36353cea-d1b8-4770-bb35-50cff351ea44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:07.882138 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36353cea-d1b8-4770-bb35-50cff351ea44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:07.883164 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36353cea-d1b8-4770-bb35-50cff351ea44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:07.883300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36353cea-d1b8-4770-bb35-50cff351ea44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:07.883703 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-36353cea-d1b8-4770-bb35-50cff351ea44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:08.051803 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-36353cea-d1b8-4770-bb35-50cff351ea44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:08.054114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:40:08.060887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-36353cea-d1b8-4770-bb35-50cff351ea44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.192189 Sep 06 04:40:08.061526 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 264/508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:07 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:08.402005 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e7a17c86-bbb2-4ebc-9e23-77ad88e6a4dc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:08.402615 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e7a17c86-bbb2-4ebc-9e23-77ad88e6a4dc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:08.403280 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-1e5122a8-ab43-4044-a8bb-42deeadee55b req-87f16989-ca3a-4a7b-930b-9aae92d60afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10d37307-eefc-4b31-b42d-6042e4abee25", "name": "network-vif-deleted", "tag": "5f1f8c0d-db0b-4d23-89b3-a2a10a3f470f"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:40:08.408761 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=70 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:40:08.409460 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7a17c86-bbb2-4ebc-9e23-77ad88e6a4dc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:08.409951 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7a17c86-bbb2-4ebc-9e23-77ad88e6a4dc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:08.410380 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7a17c86-bbb2-4ebc-9e23-77ad88e6a4dc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:08.411074 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7a17c86-bbb2-4ebc-9e23-77ad88e6a4dc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:08.411527 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7a17c86-bbb2-4ebc-9e23-77ad88e6a4dc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:08.411961 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7a17c86-bbb2-4ebc-9e23-77ad88e6a4dc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:08.415357 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-1e5122a8-ab43-4044-a8bb-42deeadee55b req-87f16989-ca3a-4a7b-930b-9aae92d60afe service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:08.417214 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-1e5122a8-ab43-4044-a8bb-42deeadee55b req-87f16989-ca3a-4a7b-930b-9aae92d60afe service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:08.417214 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-1e5122a8-ab43-4044-a8bb-42deeadee55b req-87f16989-ca3a-4a7b-930b-9aae92d60afe service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:08.428717 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-1e5122a8-ab43-4044-a8bb-42deeadee55b req-87f16989-ca3a-4a7b-930b-9aae92d60afe service nova] Creating event network-vif-deleted:5f1f8c0d-db0b-4d23-89b3-a2a10a3f470f for instance 10d37307-eefc-4b31-b42d-6042e4abee25 on hv-cinder-85600 Sep 06 04:40:08.434032 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-1e5122a8-ab43-4044-a8bb-42deeadee55b req-87f16989-ca3a-4a7b-930b-9aae92d60afe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035045 Sep 06 04:40:08.435683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 265/509] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:40:08.789703 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e7a17c86-bbb2-4ebc-9e23-77ad88e6a4dc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:08.798456 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e7a17c86-bbb2-4ebc-9e23-77ad88e6a4dc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:08.799883 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e7a17c86-bbb2-4ebc-9e23-77ad88e6a4dc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:08.801475 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e7a17c86-bbb2-4ebc-9e23-77ad88e6a4dc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.403406 Sep 06 04:40:08.802036 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 245/510] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:08 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:08.889738 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-11ee23ee-ed39-4d07-91cb-f72e2bf3662b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:08.890419 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-11ee23ee-ed39-4d07-91cb-f72e2bf3662b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:08.897269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11ee23ee-ed39-4d07-91cb-f72e2bf3662b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:08.897764 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11ee23ee-ed39-4d07-91cb-f72e2bf3662b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:08.898187 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11ee23ee-ed39-4d07-91cb-f72e2bf3662b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:08.898854 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11ee23ee-ed39-4d07-91cb-f72e2bf3662b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:08.899297 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11ee23ee-ed39-4d07-91cb-f72e2bf3662b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:08.899715 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-11ee23ee-ed39-4d07-91cb-f72e2bf3662b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:08.960003 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-11ee23ee-ed39-4d07-91cb-f72e2bf3662b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:08.968188 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-11ee23ee-ed39-4d07-91cb-f72e2bf3662b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1303 microversion: 2.1 time: 0.082762 Sep 06 04:40:08.968747 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 266/511] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:08 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1303 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:09.084604 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-21c2fe88-1a0e-41b1-99c7-dca569f6ac8f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:09.085216 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-21c2fe88-1a0e-41b1-99c7-dca569f6ac8f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:09.092029 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21c2fe88-1a0e-41b1-99c7-dca569f6ac8f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:09.092728 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21c2fe88-1a0e-41b1-99c7-dca569f6ac8f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:09.093854 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21c2fe88-1a0e-41b1-99c7-dca569f6ac8f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:09.093990 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21c2fe88-1a0e-41b1-99c7-dca569f6ac8f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:09.094420 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21c2fe88-1a0e-41b1-99c7-dca569f6ac8f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:09.095180 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-21c2fe88-1a0e-41b1-99c7-dca569f6ac8f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:09.220181 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-21c2fe88-1a0e-41b1-99c7-dca569f6ac8f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:09.227729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-21c2fe88-1a0e-41b1-99c7-dca569f6ac8f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.146907 Sep 06 04:40:09.228298 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 246/512] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:09 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:09.828222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-99a5698c-5786-46f7-b588-6896c9422990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:09.828824 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-99a5698c-5786-46f7-b588-6896c9422990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:09.835525 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99a5698c-5786-46f7-b588-6896c9422990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:09.835992 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99a5698c-5786-46f7-b588-6896c9422990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:09.836431 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99a5698c-5786-46f7-b588-6896c9422990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:09.840883 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99a5698c-5786-46f7-b588-6896c9422990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:09.841698 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99a5698c-5786-46f7-b588-6896c9422990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:09.842137 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-99a5698c-5786-46f7-b588-6896c9422990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:09.972480 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-99a5698c-5786-46f7-b588-6896c9422990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:09.980675 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-99a5698c-5786-46f7-b588-6896c9422990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:09.982815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-99a5698c-5786-46f7-b588-6896c9422990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:09.983976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-99a5698c-5786-46f7-b588-6896c9422990 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1739 microversion: 2.20 time: 0.160158 Sep 06 04:40:09.984799 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 267/513] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:09 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:09.991215 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-69f7db16-3fac-46bd-bd16-831587c7763a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:09.991852 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-69f7db16-3fac-46bd-bd16-831587c7763a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:10.000939 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69f7db16-3fac-46bd-bd16-831587c7763a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:10.002934 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69f7db16-3fac-46bd-bd16-831587c7763a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:10.002934 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69f7db16-3fac-46bd-bd16-831587c7763a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:10.004570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69f7db16-3fac-46bd-bd16-831587c7763a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:10.005035 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69f7db16-3fac-46bd-bd16-831587c7763a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:10.005498 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-69f7db16-3fac-46bd-bd16-831587c7763a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:10.022533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:40:10.071854 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-69f7db16-3fac-46bd-bd16-831587c7763a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:10.079618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-69f7db16-3fac-46bd-bd16-831587c7763a tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1303 microversion: 2.1 time: 0.092918 Sep 06 04:40:10.080177 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 247/514] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:09 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1303 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:10.251344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ddc9082f-a60c-40ac-b661-a9532090841f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:10.251979 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ddc9082f-a60c-40ac-b661-a9532090841f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:10.258056 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ddc9082f-a60c-40ac-b661-a9532090841f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:10.258539 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ddc9082f-a60c-40ac-b661-a9532090841f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:10.258968 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ddc9082f-a60c-40ac-b661-a9532090841f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:10.259647 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ddc9082f-a60c-40ac-b661-a9532090841f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:10.260098 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ddc9082f-a60c-40ac-b661-a9532090841f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:10.260517 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ddc9082f-a60c-40ac-b661-a9532090841f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:10.406523 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ddc9082f-a60c-40ac-b661-a9532090841f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:10.414587 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ddc9082f-a60c-40ac-b661-a9532090841f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1259 microversion: 2.1 time: 0.167615 Sep 06 04:40:10.415228 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 268/515] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:10 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:11.009274 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-217274e6-85c7-48bb-b3e9-e13e16f2b78b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:11.010037 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-217274e6-85c7-48bb-b3e9-e13e16f2b78b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:11.017025 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-217274e6-85c7-48bb-b3e9-e13e16f2b78b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:11.017540 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-217274e6-85c7-48bb-b3e9-e13e16f2b78b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:11.017974 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-217274e6-85c7-48bb-b3e9-e13e16f2b78b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:11.018659 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-217274e6-85c7-48bb-b3e9-e13e16f2b78b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:11.019112 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-217274e6-85c7-48bb-b3e9-e13e16f2b78b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:11.019531 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-217274e6-85c7-48bb-b3e9-e13e16f2b78b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:11.103635 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-62a83778-c8eb-4e96-8ca5-1db03f62db7c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:11.104539 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-62a83778-c8eb-4e96-8ca5-1db03f62db7c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:11.116298 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62a83778-c8eb-4e96-8ca5-1db03f62db7c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:11.116967 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62a83778-c8eb-4e96-8ca5-1db03f62db7c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:11.117421 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62a83778-c8eb-4e96-8ca5-1db03f62db7c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:11.118152 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62a83778-c8eb-4e96-8ca5-1db03f62db7c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:11.118603 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62a83778-c8eb-4e96-8ca5-1db03f62db7c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:11.119031 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62a83778-c8eb-4e96-8ca5-1db03f62db7c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:11.152793 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62a83778-c8eb-4e96-8ca5-1db03f62db7c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:11.153843 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62a83778-c8eb-4e96-8ca5-1db03f62db7c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:11.153843 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-62a83778-c8eb-4e96-8ca5-1db03f62db7c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:11.154241 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-62a83778-c8eb-4e96-8ca5-1db03f62db7c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lazy-loading 'fault' on Instance uuid 10d37307-eefc-4b31-b42d-6042e4abee25 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:40:11.198473 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-62a83778-c8eb-4e96-8ca5-1db03f62db7c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:11.206967 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-62a83778-c8eb-4e96-8ca5-1db03f62db7c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1308 microversion: 2.1 time: 0.107504 Sep 06 04:40:11.207989 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 269/516] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:11 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1308 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:40:11.263397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-217274e6-85c7-48bb-b3e9-e13e16f2b78b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:11.271890 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-217274e6-85c7-48bb-b3e9-e13e16f2b78b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:11.273414 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-217274e6-85c7-48bb-b3e9-e13e16f2b78b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:11.274698 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-217274e6-85c7-48bb-b3e9-e13e16f2b78b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1721 microversion: 2.20 time: 0.269729 Sep 06 04:40:11.275630 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 248/517] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:11 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:11.438268 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8d462f55-6f9a-417c-a835-043be35c7e44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:11.438881 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8d462f55-6f9a-417c-a835-043be35c7e44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:11.444755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d462f55-6f9a-417c-a835-043be35c7e44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:11.445237 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d462f55-6f9a-417c-a835-043be35c7e44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:11.445704 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d462f55-6f9a-417c-a835-043be35c7e44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:11.446387 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d462f55-6f9a-417c-a835-043be35c7e44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:11.446846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d462f55-6f9a-417c-a835-043be35c7e44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:11.447270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d462f55-6f9a-417c-a835-043be35c7e44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:11.572391 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8d462f55-6f9a-417c-a835-043be35c7e44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:11.580159 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8d462f55-6f9a-417c-a835-043be35c7e44 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1442 microversion: 2.1 time: 0.146605 Sep 06 04:40:11.580725 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 270/518] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:11 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1442 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:11.602862 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-161e9251-db6a-47e4-b6cd-321d8b9c0ee0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:11.603493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-161e9251-db6a-47e4-b6cd-321d8b9c0ee0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:11.610081 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-161e9251-db6a-47e4-b6cd-321d8b9c0ee0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:11.610559 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-161e9251-db6a-47e4-b6cd-321d8b9c0ee0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:11.610983 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-161e9251-db6a-47e4-b6cd-321d8b9c0ee0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:11.611654 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-161e9251-db6a-47e4-b6cd-321d8b9c0ee0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:11.612096 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-161e9251-db6a-47e4-b6cd-321d8b9c0ee0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:11.612509 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-161e9251-db6a-47e4-b6cd-321d8b9c0ee0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:11.809859 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-161e9251-db6a-47e4-b6cd-321d8b9c0ee0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:11.818049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-161e9251-db6a-47e4-b6cd-321d8b9c0ee0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1442 microversion: 2.1 time: 0.218930 Sep 06 04:40:11.818618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 249/519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:11 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1442 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:12.231036 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0bf8966e-cf33-40ce-91ac-ef96cf7b425f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:12.232749 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0bf8966e-cf33-40ce-91ac-ef96cf7b425f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:12.239206 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bf8966e-cf33-40ce-91ac-ef96cf7b425f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:12.239669 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bf8966e-cf33-40ce-91ac-ef96cf7b425f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:12.240100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bf8966e-cf33-40ce-91ac-ef96cf7b425f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:12.240918 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bf8966e-cf33-40ce-91ac-ef96cf7b425f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:12.241420 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bf8966e-cf33-40ce-91ac-ef96cf7b425f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:12.241892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bf8966e-cf33-40ce-91ac-ef96cf7b425f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:12.274796 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bf8966e-cf33-40ce-91ac-ef96cf7b425f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:12.275283 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bf8966e-cf33-40ce-91ac-ef96cf7b425f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:12.275837 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bf8966e-cf33-40ce-91ac-ef96cf7b425f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:12.276161 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-0bf8966e-cf33-40ce-91ac-ef96cf7b425f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lazy-loading 'fault' on Instance uuid 10d37307-eefc-4b31-b42d-6042e4abee25 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:40:12.300069 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dad47a2f-642a-4fd3-88d9-22b3c4c96324 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:12.300818 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dad47a2f-642a-4fd3-88d9-22b3c4c96324 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:12.304252 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:40:12.308560 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dad47a2f-642a-4fd3-88d9-22b3c4c96324 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:12.309043 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dad47a2f-642a-4fd3-88d9-22b3c4c96324 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:12.309520 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dad47a2f-642a-4fd3-88d9-22b3c4c96324 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:12.310749 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dad47a2f-642a-4fd3-88d9-22b3c4c96324 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:12.311264 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dad47a2f-642a-4fd3-88d9-22b3c4c96324 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:12.311709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dad47a2f-642a-4fd3-88d9-22b3c4c96324 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:12.323730 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0bf8966e-cf33-40ce-91ac-ef96cf7b425f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:12.333406 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0bf8966e-cf33-40ce-91ac-ef96cf7b425f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1308 microversion: 2.1 time: 0.105942 Sep 06 04:40:12.333733 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 271/520] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:12 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:12.494158 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dad47a2f-642a-4fd3-88d9-22b3c4c96324 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:12.504548 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dad47a2f-642a-4fd3-88d9-22b3c4c96324 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:12.506024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dad47a2f-642a-4fd3-88d9-22b3c4c96324 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:12.507289 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dad47a2f-642a-4fd3-88d9-22b3c4c96324 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1721 microversion: 2.20 time: 0.211042 Sep 06 04:40:12.507853 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 250/521] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:12 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:12.564925 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-c7549f93-df24-4860-9155-4435e388d8e9 req-e4fbd1d9-6c44-4a13-8eb6-30e4d8356d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53238a8f-2601-4952-acd2-4dcb02761c12", "name": "network-vif-unplugged", "status": "completed", "tag": "19322183-60e8-44ac-b690-7448dfce3250"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:40:12.574812 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c7549f93-df24-4860-9155-4435e388d8e9 req-e4fbd1d9-6c44-4a13-8eb6-30e4d8356d54 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:12.575295 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c7549f93-df24-4860-9155-4435e388d8e9 req-e4fbd1d9-6c44-4a13-8eb6-30e4d8356d54 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:12.575762 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c7549f93-df24-4860-9155-4435e388d8e9 req-e4fbd1d9-6c44-4a13-8eb6-30e4d8356d54 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:12.587118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-c7549f93-df24-4860-9155-4435e388d8e9 req-e4fbd1d9-6c44-4a13-8eb6-30e4d8356d54 service nova] Creating event network-vif-unplugged:19322183-60e8-44ac-b690-7448dfce3250 for instance 53238a8f-2601-4952-acd2-4dcb02761c12 on hv-cinder-85600 Sep 06 04:40:12.592660 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-c7549f93-df24-4860-9155-4435e388d8e9 req-e4fbd1d9-6c44-4a13-8eb6-30e4d8356d54 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031364 Sep 06 04:40:12.593448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 272/522] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:40:13.355905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4eb15f0a-4aa6-480a-87d5-1ed96767e6b3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:13.356511 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4eb15f0a-4aa6-480a-87d5-1ed96767e6b3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:13.363893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4eb15f0a-4aa6-480a-87d5-1ed96767e6b3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:13.364380 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4eb15f0a-4aa6-480a-87d5-1ed96767e6b3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:13.364805 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4eb15f0a-4aa6-480a-87d5-1ed96767e6b3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:13.365526 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4eb15f0a-4aa6-480a-87d5-1ed96767e6b3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:13.365974 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4eb15f0a-4aa6-480a-87d5-1ed96767e6b3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:13.366387 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4eb15f0a-4aa6-480a-87d5-1ed96767e6b3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:13.399509 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4eb15f0a-4aa6-480a-87d5-1ed96767e6b3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:13.399967 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4eb15f0a-4aa6-480a-87d5-1ed96767e6b3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:13.400390 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4eb15f0a-4aa6-480a-87d5-1ed96767e6b3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:13.400849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-4eb15f0a-4aa6-480a-87d5-1ed96767e6b3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lazy-loading 'fault' on Instance uuid 10d37307-eefc-4b31-b42d-6042e4abee25 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:40:13.477769 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4eb15f0a-4aa6-480a-87d5-1ed96767e6b3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:13.486330 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4eb15f0a-4aa6-480a-87d5-1ed96767e6b3 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 200 len: 1308 microversion: 2.1 time: 0.134983 Sep 06 04:40:13.486907 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 251/523] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:13 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 1308 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:13.534448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9e4892f1-e9f4-469e-8289-3f9bc6adb55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:13.535004 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9e4892f1-e9f4-469e-8289-3f9bc6adb55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:13.540990 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e4892f1-e9f4-469e-8289-3f9bc6adb55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:13.541514 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e4892f1-e9f4-469e-8289-3f9bc6adb55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:13.541942 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e4892f1-e9f4-469e-8289-3f9bc6adb55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:13.542854 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e4892f1-e9f4-469e-8289-3f9bc6adb55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:13.543562 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e4892f1-e9f4-469e-8289-3f9bc6adb55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:13.544079 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e4892f1-e9f4-469e-8289-3f9bc6adb55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:13.679413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9e4892f1-e9f4-469e-8289-3f9bc6adb55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:13.688367 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9e4892f1-e9f4-469e-8289-3f9bc6adb55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:13.693353 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9e4892f1-e9f4-469e-8289-3f9bc6adb55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:13.693353 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9e4892f1-e9f4-469e-8289-3f9bc6adb55b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1721 microversion: 2.20 time: 0.162426 Sep 06 04:40:13.693353 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 273/524] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:13 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:13.998623 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-2a5c8c6d-18f2-43de-88c1-f000dcefff63 req-2e68f657-6923-4d54-b830-fcfc86ffef1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddad572e-12e1-4699-ba46-16c1ccb25704", "tag": "784c9a84-7d0f-461b-810d-b0f2b91e1d43"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:40:14.010385 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2a5c8c6d-18f2-43de-88c1-f000dcefff63 req-2e68f657-6923-4d54-b830-fcfc86ffef1c service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:14.010871 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2a5c8c6d-18f2-43de-88c1-f000dcefff63 req-2e68f657-6923-4d54-b830-fcfc86ffef1c service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:14.011299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2a5c8c6d-18f2-43de-88c1-f000dcefff63 req-2e68f657-6923-4d54-b830-fcfc86ffef1c service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:14.023008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-2a5c8c6d-18f2-43de-88c1-f000dcefff63 req-2e68f657-6923-4d54-b830-fcfc86ffef1c service nova] Creating event network-changed:784c9a84-7d0f-461b-810d-b0f2b91e1d43 for instance ddad572e-12e1-4699-ba46-16c1ccb25704 on hv-cinder-85600 Sep 06 04:40:14.028086 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-2a5c8c6d-18f2-43de-88c1-f000dcefff63 req-2e68f657-6923-4d54-b830-fcfc86ffef1c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034209 Sep 06 04:40:14.029543 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 252/525] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:40:14.509805 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-08291294-0eaa-4421-93ed-acdd9ba738a5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:14.510418 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-08291294-0eaa-4421-93ed-acdd9ba738a5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 10d37307-eefc-4b31-b42d-6042e4abee25] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:14.516587 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-08291294-0eaa-4421-93ed-acdd9ba738a5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:14.517374 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-08291294-0eaa-4421-93ed-acdd9ba738a5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:14.517807 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-08291294-0eaa-4421-93ed-acdd9ba738a5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:14.518497 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-08291294-0eaa-4421-93ed-acdd9ba738a5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:14.519093 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-08291294-0eaa-4421-93ed-acdd9ba738a5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:14.519519 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-08291294-0eaa-4421-93ed-acdd9ba738a5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:14.534563 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-08291294-0eaa-4421-93ed-acdd9ba738a5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] HTTP exception thrown: Instance 10d37307-eefc-4b31-b42d-6042e4abee25 could not be found. Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-08291294-0eaa-4421-93ed-acdd9ba738a5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Request method failure captured: Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 HTTP/1.1 Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs67Cer-d-mOhP7dkvMjwIj7aEDLffOVUly7QPXVx6qkKQHxll4jozXWYPrETF-RhTSJGyM-MPF8WMC-QzPLcFnJ7OcEOR-WANlzVCC7Dig37b-z92Z24eGtYYQMKQQ2deRrfRSiVhag8uYmBPLNDXz0qROT8IaGL88Iv4zSr98vr2M Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 36495849f5124872ba74fe21b00f72fe Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1413552789 Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:40:14.536199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:40:14.537853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/36495849f5124872ba74fe21b00f72fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/36495849f5124872ba74fe21b00f72fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_36495849f5124872ba74fe21b00f72fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/36495849f5124872ba74fe21b00f72fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:40:14.537853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesSnapshotTestJSON-1413552789 Sep 06 04:40:14.537853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 36495849f5124872ba74fe21b00f72fe Sep 06 04:40:14.537853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1413552789 Sep 06 04:40:14.537853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesSnapshotTestJSON-1413552789-project Sep 06 04:40:14.537853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:40:14.537853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:40:14.537853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 784815b8c6d0400c92caa54981b137d9 Sep 06 04:40:14.537853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesSnapshotTestJSON-1413552789-project Sep 06 04:40:14.537853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:40:14.537853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 10d37307-eefc-4b31-b42d-6042e4abee25 could not be found. Sep 06 04:40:14.537853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '10d37307-eefc-4b31-b42d-6042e4abee25'} Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10d37307-eefc-4b31-b42d-6042e4abee25 could not be found. Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:40:14.538892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10d37307-eefc-4b31-b42d-6042e4abee25 could not be found. Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10d37307-eefc-4b31-b42d-6042e4abee25 could not be found. Sep 06 04:40:14.540702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:40:14.541972 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-08291294-0eaa-4421-93ed-acdd9ba738a5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Returning 404 to user: Instance 10d37307-eefc-4b31-b42d-6042e4abee25 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:40:14.541972 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-08291294-0eaa-4421-93ed-acdd9ba738a5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25" status: 404 len: 111 microversion: 2.1 time: 0.031629 Sep 06 04:40:14.542342 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 274/526] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:14 2022] GET /compute/v2.1/servers/10d37307-eefc-4b31-b42d-6042e4abee25 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:40:14.716232 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b5039f2f-9de2-42ae-8fc7-aecf96c02acd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:14.717880 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b5039f2f-9de2-42ae-8fc7-aecf96c02acd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:14.725213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5039f2f-9de2-42ae-8fc7-aecf96c02acd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:14.726244 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5039f2f-9de2-42ae-8fc7-aecf96c02acd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:14.726859 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5039f2f-9de2-42ae-8fc7-aecf96c02acd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:14.727745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5039f2f-9de2-42ae-8fc7-aecf96c02acd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:14.728384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5039f2f-9de2-42ae-8fc7-aecf96c02acd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:14.728870 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b5039f2f-9de2-42ae-8fc7-aecf96c02acd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:14.956418 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b5039f2f-9de2-42ae-8fc7-aecf96c02acd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:14.965247 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b5039f2f-9de2-42ae-8fc7-aecf96c02acd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:14.967142 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b5039f2f-9de2-42ae-8fc7-aecf96c02acd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:14.968313 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b5039f2f-9de2-42ae-8fc7-aecf96c02acd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1724 microversion: 2.20 time: 0.256508 Sep 06 04:40:14.968870 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 253/527] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:14 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:14.995121 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-67762eee-80e5-474e-b12e-d8b50cb67306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a86fa61-7fa6-4c3e-acd6-4ad937cd7b7e"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:40:14.997901 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-67762eee-80e5-474e-b12e-d8b50cb67306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:15.004745 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67762eee-80e5-474e-b12e-d8b50cb67306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:15.005518 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67762eee-80e5-474e-b12e-d8b50cb67306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:15.006170 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67762eee-80e5-474e-b12e-d8b50cb67306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:15.006966 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67762eee-80e5-474e-b12e-d8b50cb67306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:15.007611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67762eee-80e5-474e-b12e-d8b50cb67306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:15.007914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-67762eee-80e5-474e-b12e-d8b50cb67306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:15.996325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-67762eee-80e5-474e-b12e-d8b50cb67306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "POST /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.005154 Sep 06 04:40:15.996956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 275/528] 10.222.0.30 () {62 vars in 1364 bytes} [Tue Sep 6 04:40:14 2022] POST /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/os-volume_attachments => generated 188 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:40:16.128523 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a2a27cbf-cf93-46c7-ad0a-95b5e9186eb1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:40:16.129114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a2a27cbf-cf93-46c7-ad0a-95b5e9186eb1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:16.135640 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2a27cbf-cf93-46c7-ad0a-95b5e9186eb1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:16.136120 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2a27cbf-cf93-46c7-ad0a-95b5e9186eb1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:16.136550 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2a27cbf-cf93-46c7-ad0a-95b5e9186eb1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:16.137232 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2a27cbf-cf93-46c7-ad0a-95b5e9186eb1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:16.139375 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2a27cbf-cf93-46c7-ad0a-95b5e9186eb1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:16.139807 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2a27cbf-cf93-46c7-ad0a-95b5e9186eb1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:16.181596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a2a27cbf-cf93-46c7-ad0a-95b5e9186eb1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127617) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 04:40:16.468373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a2a27cbf-cf93-46c7-ad0a-95b5e9186eb1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "POST /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/action" status: 202 len: 0 microversion: 2.20 time: 0.343676 Sep 06 04:40:16.469361 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 254/529] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Sep 6 04:40:16 2022] POST /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:40:16.477997 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bec050ac-1538-48fb-9e6f-afd9a71b933d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:16.478727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bec050ac-1538-48fb-9e6f-afd9a71b933d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:16.485684 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bec050ac-1538-48fb-9e6f-afd9a71b933d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:16.486161 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bec050ac-1538-48fb-9e6f-afd9a71b933d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:16.486590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bec050ac-1538-48fb-9e6f-afd9a71b933d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:16.487436 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bec050ac-1538-48fb-9e6f-afd9a71b933d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:16.488015 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bec050ac-1538-48fb-9e6f-afd9a71b933d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:16.488454 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bec050ac-1538-48fb-9e6f-afd9a71b933d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:16.620241 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bec050ac-1538-48fb-9e6f-afd9a71b933d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:16.629829 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bec050ac-1538-48fb-9e6f-afd9a71b933d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:16.631240 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bec050ac-1538-48fb-9e6f-afd9a71b933d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:16.632381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bec050ac-1538-48fb-9e6f-afd9a71b933d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1750 microversion: 2.20 time: 0.158617 Sep 06 04:40:16.632924 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 276/530] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:16 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:17.659373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a97fad4e-3c00-4d51-9e1b-4b423b5313dd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:17.660014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a97fad4e-3c00-4d51-9e1b-4b423b5313dd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:17.667763 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a97fad4e-3c00-4d51-9e1b-4b423b5313dd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:17.667763 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a97fad4e-3c00-4d51-9e1b-4b423b5313dd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:17.667763 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a97fad4e-3c00-4d51-9e1b-4b423b5313dd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:17.668594 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a97fad4e-3c00-4d51-9e1b-4b423b5313dd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:17.669100 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a97fad4e-3c00-4d51-9e1b-4b423b5313dd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:17.670265 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a97fad4e-3c00-4d51-9e1b-4b423b5313dd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:17.799500 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a97fad4e-3c00-4d51-9e1b-4b423b5313dd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:17.808235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a97fad4e-3c00-4d51-9e1b-4b423b5313dd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:17.809761 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a97fad4e-3c00-4d51-9e1b-4b423b5313dd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:17.811117 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a97fad4e-3c00-4d51-9e1b-4b423b5313dd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1750 microversion: 2.20 time: 0.156385 Sep 06 04:40:17.811675 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 255/531] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:17 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:18.836335 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-82b3b64e-2f53-4a73-9e7c-2a8ff493aad0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:18.836940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-82b3b64e-2f53-4a73-9e7c-2a8ff493aad0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:18.844068 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82b3b64e-2f53-4a73-9e7c-2a8ff493aad0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:18.844546 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82b3b64e-2f53-4a73-9e7c-2a8ff493aad0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:18.844979 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82b3b64e-2f53-4a73-9e7c-2a8ff493aad0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:18.845682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82b3b64e-2f53-4a73-9e7c-2a8ff493aad0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:18.846134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82b3b64e-2f53-4a73-9e7c-2a8ff493aad0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:18.846555 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82b3b64e-2f53-4a73-9e7c-2a8ff493aad0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:19.020666 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-82b3b64e-2f53-4a73-9e7c-2a8ff493aad0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:19.030042 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-82b3b64e-2f53-4a73-9e7c-2a8ff493aad0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:19.031464 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-82b3b64e-2f53-4a73-9e7c-2a8ff493aad0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:19.032602 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-82b3b64e-2f53-4a73-9e7c-2a8ff493aad0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1750 microversion: 2.20 time: 0.200178 Sep 06 04:40:19.033151 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 277/532] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:18 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1750 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:20.057587 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-be6627d7-faa9-4188-946f-030696de7a37 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:20.058197 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-be6627d7-faa9-4188-946f-030696de7a37 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:20.064692 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be6627d7-faa9-4188-946f-030696de7a37 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:20.065175 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be6627d7-faa9-4188-946f-030696de7a37 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:20.065642 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be6627d7-faa9-4188-946f-030696de7a37 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:20.066329 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be6627d7-faa9-4188-946f-030696de7a37 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:20.066778 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be6627d7-faa9-4188-946f-030696de7a37 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:20.067227 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be6627d7-faa9-4188-946f-030696de7a37 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:20.197161 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-be6627d7-faa9-4188-946f-030696de7a37 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:20.207317 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-be6627d7-faa9-4188-946f-030696de7a37 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:20.216967 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-be6627d7-faa9-4188-946f-030696de7a37 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:20.217103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-be6627d7-faa9-4188-946f-030696de7a37 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1752 microversion: 2.20 time: 0.163341 Sep 06 04:40:20.217985 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 256/533] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:20 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:21.243060 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-58982675-9ed2-44be-9fd6-23890adea699 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:21.243694 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-58982675-9ed2-44be-9fd6-23890adea699 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:21.251387 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58982675-9ed2-44be-9fd6-23890adea699 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:21.251864 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58982675-9ed2-44be-9fd6-23890adea699 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:21.252299 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58982675-9ed2-44be-9fd6-23890adea699 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:21.252979 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58982675-9ed2-44be-9fd6-23890adea699 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:21.253460 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58982675-9ed2-44be-9fd6-23890adea699 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:21.253882 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58982675-9ed2-44be-9fd6-23890adea699 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:21.389824 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-58982675-9ed2-44be-9fd6-23890adea699 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:21.398374 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-58982675-9ed2-44be-9fd6-23890adea699 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:21.399865 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-58982675-9ed2-44be-9fd6-23890adea699 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:21.400955 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-58982675-9ed2-44be-9fd6-23890adea699 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1752 microversion: 2.20 time: 0.161759 Sep 06 04:40:21.401804 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 278/534] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:21 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:22.427064 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cb30dec1-88db-4bc1-8255-8c24eca7fa68 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:22.430486 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cb30dec1-88db-4bc1-8255-8c24eca7fa68 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:22.434278 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb30dec1-88db-4bc1-8255-8c24eca7fa68 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:22.434906 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb30dec1-88db-4bc1-8255-8c24eca7fa68 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:22.435651 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb30dec1-88db-4bc1-8255-8c24eca7fa68 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:22.436351 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb30dec1-88db-4bc1-8255-8c24eca7fa68 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:22.436802 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb30dec1-88db-4bc1-8255-8c24eca7fa68 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:22.437221 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb30dec1-88db-4bc1-8255-8c24eca7fa68 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:22.929266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cb30dec1-88db-4bc1-8255-8c24eca7fa68 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:22.938707 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cb30dec1-88db-4bc1-8255-8c24eca7fa68 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:22.940165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cb30dec1-88db-4bc1-8255-8c24eca7fa68 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:22.941333 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cb30dec1-88db-4bc1-8255-8c24eca7fa68 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.518245 Sep 06 04:40:22.941891 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 257/535] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:22 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:23.967660 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d2986941-4a57-4c8c-a308-bd1533ad91ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:23.968267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d2986941-4a57-4c8c-a308-bd1533ad91ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:23.974759 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2986941-4a57-4c8c-a308-bd1533ad91ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:23.975235 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2986941-4a57-4c8c-a308-bd1533ad91ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:23.975660 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2986941-4a57-4c8c-a308-bd1533ad91ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:23.976346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2986941-4a57-4c8c-a308-bd1533ad91ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:23.976793 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2986941-4a57-4c8c-a308-bd1533ad91ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:23.977547 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2986941-4a57-4c8c-a308-bd1533ad91ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:24.107595 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d2986941-4a57-4c8c-a308-bd1533ad91ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:24.116202 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d2986941-4a57-4c8c-a308-bd1533ad91ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:24.117667 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d2986941-4a57-4c8c-a308-bd1533ad91ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:24.118818 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d2986941-4a57-4c8c-a308-bd1533ad91ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.155733 Sep 06 04:40:24.119362 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 279/536] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:23 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:25.143973 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fbffae3a-5fac-41e5-88f4-017f7d1c51ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:25.144594 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fbffae3a-5fac-41e5-88f4-017f7d1c51ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:25.151028 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbffae3a-5fac-41e5-88f4-017f7d1c51ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:25.151505 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbffae3a-5fac-41e5-88f4-017f7d1c51ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:25.152199 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbffae3a-5fac-41e5-88f4-017f7d1c51ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:25.152874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbffae3a-5fac-41e5-88f4-017f7d1c51ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:25.154109 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbffae3a-5fac-41e5-88f4-017f7d1c51ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:25.154679 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fbffae3a-5fac-41e5-88f4-017f7d1c51ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:25.281832 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fbffae3a-5fac-41e5-88f4-017f7d1c51ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:25.290326 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fbffae3a-5fac-41e5-88f4-017f7d1c51ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:25.291755 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fbffae3a-5fac-41e5-88f4-017f7d1c51ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:25.292894 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fbffae3a-5fac-41e5-88f4-017f7d1c51ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.152786 Sep 06 04:40:25.293489 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 258/537] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:25 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:26.318435 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-556aeb59-9234-48f5-b202-ca661b80199d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:26.319031 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-556aeb59-9234-48f5-b202-ca661b80199d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:26.325584 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-556aeb59-9234-48f5-b202-ca661b80199d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:26.326054 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-556aeb59-9234-48f5-b202-ca661b80199d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:26.326487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-556aeb59-9234-48f5-b202-ca661b80199d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:26.327150 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-556aeb59-9234-48f5-b202-ca661b80199d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:26.327594 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-556aeb59-9234-48f5-b202-ca661b80199d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:26.328005 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-556aeb59-9234-48f5-b202-ca661b80199d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:26.330637 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:40:26.457426 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-556aeb59-9234-48f5-b202-ca661b80199d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:26.465984 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-556aeb59-9234-48f5-b202-ca661b80199d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:26.467442 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-556aeb59-9234-48f5-b202-ca661b80199d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:26.468714 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-556aeb59-9234-48f5-b202-ca661b80199d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.154058 Sep 06 04:40:26.469185 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 280/538] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:26 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:27.331573 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1256922558", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "networks": [{"uuid": "4fde5cd2-7805-4052-b982-e07ad789f60a"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:40:27.389148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] validate_networks() for [('4fde5cd2-7805-4052-b982-e07ad789f60a', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:40:27.494139 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-858edc49-f1b0-4f67-83a9-2208dd7b519a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:27.494850 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-858edc49-f1b0-4f67-83a9-2208dd7b519a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:27.502230 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-858edc49-f1b0-4f67-83a9-2208dd7b519a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:27.502930 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-858edc49-f1b0-4f67-83a9-2208dd7b519a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:27.503432 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-858edc49-f1b0-4f67-83a9-2208dd7b519a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:27.504236 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-858edc49-f1b0-4f67-83a9-2208dd7b519a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:27.504955 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-858edc49-f1b0-4f67-83a9-2208dd7b519a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:27.505471 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-858edc49-f1b0-4f67-83a9-2208dd7b519a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:27.654972 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-858edc49-f1b0-4f67-83a9-2208dd7b519a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:27.663822 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-858edc49-f1b0-4f67-83a9-2208dd7b519a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:27.665245 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-858edc49-f1b0-4f67-83a9-2208dd7b519a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:27.666424 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-858edc49-f1b0-4f67-83a9-2208dd7b519a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.176134 Sep 06 04:40:27.666973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 281/539] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:27 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:40:27.777884 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:40:27.778877 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:40:27.779512 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:40:27.779931 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:40:27.780478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:40:27.789752 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:27.790265 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:27.790892 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:27.791618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:27.792071 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:27.792677 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:27.809698 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Getting quotas for project 36495849f5124872ba74fe21b00f72fe. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:40:27.813770 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Getting quotas for user 784815b8c6d0400c92caa54981b137d9 and project 36495849f5124872ba74fe21b00f72fe. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:40:27.824792 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:40:27.832161 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:40:27.948479 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f1a7e48c-7533-416e-b8a0-b5ad9da7fa9f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620605 Sep 06 04:40:27.949154 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 259/540] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:40:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:40:27.960910 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1e376fb1-4796-4266-a409-54d46ed62410 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:27.961648 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1e376fb1-4796-4266-a409-54d46ed62410 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:28.016446 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1e376fb1-4796-4266-a409-54d46ed62410 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:28.024041 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1e376fb1-4796-4266-a409-54d46ed62410 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1219 microversion: 2.1 time: 0.066992 Sep 06 04:40:28.026321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 282/541] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:27 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:28.693496 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fe970039-1ef9-4ef0-8444-fe7fc421438c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:28.694107 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fe970039-1ef9-4ef0-8444-fe7fc421438c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:28.701681 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fe970039-1ef9-4ef0-8444-fe7fc421438c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:28.702501 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fe970039-1ef9-4ef0-8444-fe7fc421438c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:28.703357 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fe970039-1ef9-4ef0-8444-fe7fc421438c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:28.704644 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fe970039-1ef9-4ef0-8444-fe7fc421438c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:28.705347 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fe970039-1ef9-4ef0-8444-fe7fc421438c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:28.706223 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fe970039-1ef9-4ef0-8444-fe7fc421438c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:28.848643 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fe970039-1ef9-4ef0-8444-fe7fc421438c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:28.858574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fe970039-1ef9-4ef0-8444-fe7fc421438c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:28.860029 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fe970039-1ef9-4ef0-8444-fe7fc421438c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:28.861196 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fe970039-1ef9-4ef0-8444-fe7fc421438c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.172328 Sep 06 04:40:28.871646 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 260/542] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:28 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:29.047493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e13805ca-32be-4591-b2bd-1afa9039d877 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:29.048092 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e13805ca-32be-4591-b2bd-1afa9039d877 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:29.055004 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e13805ca-32be-4591-b2bd-1afa9039d877 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:29.055477 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e13805ca-32be-4591-b2bd-1afa9039d877 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:29.055960 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e13805ca-32be-4591-b2bd-1afa9039d877 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:29.056702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e13805ca-32be-4591-b2bd-1afa9039d877 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:29.057207 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e13805ca-32be-4591-b2bd-1afa9039d877 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:29.057663 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e13805ca-32be-4591-b2bd-1afa9039d877 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:29.221429 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e13805ca-32be-4591-b2bd-1afa9039d877 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:29.221429 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e13805ca-32be-4591-b2bd-1afa9039d877 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.093242 Sep 06 04:40:29.221429 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 283/543] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:29 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:29.889286 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-968c093a-18c8-4685-b912-fc2b85b3ef6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:29.891269 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-968c093a-18c8-4685-b912-fc2b85b3ef6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:29.898976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-968c093a-18c8-4685-b912-fc2b85b3ef6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:29.899584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-968c093a-18c8-4685-b912-fc2b85b3ef6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:29.900016 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-968c093a-18c8-4685-b912-fc2b85b3ef6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:29.900714 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-968c093a-18c8-4685-b912-fc2b85b3ef6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:29.901160 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-968c093a-18c8-4685-b912-fc2b85b3ef6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:29.901852 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-968c093a-18c8-4685-b912-fc2b85b3ef6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:30.035465 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-968c093a-18c8-4685-b912-fc2b85b3ef6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:30.044899 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-968c093a-18c8-4685-b912-fc2b85b3ef6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:30.046393 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-968c093a-18c8-4685-b912-fc2b85b3ef6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:30.047777 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-968c093a-18c8-4685-b912-fc2b85b3ef6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.163710 Sep 06 04:40:30.048339 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 261/544] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:29 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:30.160339 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e8d45821-8176-4626-8055-044deeb3360b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:30.160919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e8d45821-8176-4626-8055-044deeb3360b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:30.168606 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8d45821-8176-4626-8055-044deeb3360b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:30.169225 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8d45821-8176-4626-8055-044deeb3360b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:30.169758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8d45821-8176-4626-8055-044deeb3360b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:30.170456 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8d45821-8176-4626-8055-044deeb3360b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:30.170909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8d45821-8176-4626-8055-044deeb3360b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:30.171327 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8d45821-8176-4626-8055-044deeb3360b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:30.238992 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e8d45821-8176-4626-8055-044deeb3360b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:30.247434 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e8d45821-8176-4626-8055-044deeb3360b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.090494 Sep 06 04:40:30.248004 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 284/545] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:30 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:31.188113 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-18e30575-5a24-4cc3-892a-67b15c0348d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:31.188711 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-18e30575-5a24-4cc3-892a-67b15c0348d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:31.196199 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-18e30575-5a24-4cc3-892a-67b15c0348d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:31.196760 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-18e30575-5a24-4cc3-892a-67b15c0348d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:31.197410 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-18e30575-5a24-4cc3-892a-67b15c0348d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:31.198124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-18e30575-5a24-4cc3-892a-67b15c0348d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:31.198583 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-18e30575-5a24-4cc3-892a-67b15c0348d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:31.199007 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-18e30575-5a24-4cc3-892a-67b15c0348d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:31.274393 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a6962103-0739-460c-bb14-d4351ccc075d tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:31.275014 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a6962103-0739-460c-bb14-d4351ccc075d tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:31.283528 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6962103-0739-460c-bb14-d4351ccc075d tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:31.284021 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6962103-0739-460c-bb14-d4351ccc075d tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:31.285250 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6962103-0739-460c-bb14-d4351ccc075d tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:31.287899 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6962103-0739-460c-bb14-d4351ccc075d tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:31.288371 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6962103-0739-460c-bb14-d4351ccc075d tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:31.288796 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a6962103-0739-460c-bb14-d4351ccc075d tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:31.358849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-18e30575-5a24-4cc3-892a-67b15c0348d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:31.370120 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a6962103-0739-460c-bb14-d4351ccc075d tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:31.371383 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-18e30575-5a24-4cc3-892a-67b15c0348d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:31.378178 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-18e30575-5a24-4cc3-892a-67b15c0348d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:31.381452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-18e30575-5a24-4cc3-892a-67b15c0348d7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.310066 Sep 06 04:40:31.381615 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a6962103-0739-460c-bb14-d4351ccc075d tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.112853 Sep 06 04:40:31.382062 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 262/546] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:31 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:31.382782 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 285/547] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:31 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:40:32.404168 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c0a675f6-487b-46a5-9d62-d49f88460721 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:32.404769 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c0a675f6-487b-46a5-9d62-d49f88460721 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:32.406600 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6f4915d6-4ee7-44d1-93e3-57261f69a0c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:32.407201 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6f4915d6-4ee7-44d1-93e3-57261f69a0c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:32.411137 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0a675f6-487b-46a5-9d62-d49f88460721 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:32.411612 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0a675f6-487b-46a5-9d62-d49f88460721 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:32.412044 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0a675f6-487b-46a5-9d62-d49f88460721 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:32.412721 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0a675f6-487b-46a5-9d62-d49f88460721 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:32.413163 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0a675f6-487b-46a5-9d62-d49f88460721 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:32.413487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f4915d6-4ee7-44d1-93e3-57261f69a0c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:32.413609 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c0a675f6-487b-46a5-9d62-d49f88460721 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:32.413964 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f4915d6-4ee7-44d1-93e3-57261f69a0c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:32.414392 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f4915d6-4ee7-44d1-93e3-57261f69a0c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:32.415062 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f4915d6-4ee7-44d1-93e3-57261f69a0c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:32.415507 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f4915d6-4ee7-44d1-93e3-57261f69a0c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:32.415920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f4915d6-4ee7-44d1-93e3-57261f69a0c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:32.477853 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c0a675f6-487b-46a5-9d62-d49f88460721 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:32.496217 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c0a675f6-487b-46a5-9d62-d49f88460721 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.096063 Sep 06 04:40:32.497404 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 263/548] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:32 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:32.554541 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6f4915d6-4ee7-44d1-93e3-57261f69a0c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:32.562142 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6f4915d6-4ee7-44d1-93e3-57261f69a0c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:32.563598 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6f4915d6-4ee7-44d1-93e3-57261f69a0c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:32.564752 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6f4915d6-4ee7-44d1-93e3-57261f69a0c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.162009 Sep 06 04:40:32.565329 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 286/549] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:32 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:40:33.520416 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7ea92ffa-1131-4792-9f59-a3a2f550a373 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:33.521042 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7ea92ffa-1131-4792-9f59-a3a2f550a373 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:33.527885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea92ffa-1131-4792-9f59-a3a2f550a373 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:33.528529 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea92ffa-1131-4792-9f59-a3a2f550a373 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:33.528971 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea92ffa-1131-4792-9f59-a3a2f550a373 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:33.529686 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea92ffa-1131-4792-9f59-a3a2f550a373 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:33.530139 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea92ffa-1131-4792-9f59-a3a2f550a373 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:33.530559 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ea92ffa-1131-4792-9f59-a3a2f550a373 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:33.534568 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:40:33.592503 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d71be2b1-597e-41ee-bf3b-d9a99cce3820 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:33.592946 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d71be2b1-597e-41ee-bf3b-d9a99cce3820 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:33.594332 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7ea92ffa-1131-4792-9f59-a3a2f550a373 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:33.599302 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d71be2b1-597e-41ee-bf3b-d9a99cce3820 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:33.600882 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d71be2b1-597e-41ee-bf3b-d9a99cce3820 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:33.600882 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d71be2b1-597e-41ee-bf3b-d9a99cce3820 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:33.601082 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d71be2b1-597e-41ee-bf3b-d9a99cce3820 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:33.601403 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d71be2b1-597e-41ee-bf3b-d9a99cce3820 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:33.601825 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d71be2b1-597e-41ee-bf3b-d9a99cce3820 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:33.601924 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7ea92ffa-1131-4792-9f59-a3a2f550a373 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.086550 Sep 06 04:40:33.602439 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 264/550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:33 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:33.735648 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d71be2b1-597e-41ee-bf3b-d9a99cce3820 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:33.744424 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d71be2b1-597e-41ee-bf3b-d9a99cce3820 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:33.745955 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d71be2b1-597e-41ee-bf3b-d9a99cce3820 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:33.747186 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d71be2b1-597e-41ee-bf3b-d9a99cce3820 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.159081 Sep 06 04:40:33.747760 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 287/551] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:33 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:40:34.625615 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3455f395-a6aa-4064-89da-539106bc92c2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:34.626859 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3455f395-a6aa-4064-89da-539106bc92c2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:34.634089 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3455f395-a6aa-4064-89da-539106bc92c2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:34.635009 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3455f395-a6aa-4064-89da-539106bc92c2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:34.635818 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3455f395-a6aa-4064-89da-539106bc92c2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:34.636704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3455f395-a6aa-4064-89da-539106bc92c2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:34.637342 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3455f395-a6aa-4064-89da-539106bc92c2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:34.637994 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3455f395-a6aa-4064-89da-539106bc92c2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:34.700385 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3455f395-a6aa-4064-89da-539106bc92c2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:34.707843 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3455f395-a6aa-4064-89da-539106bc92c2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.086692 Sep 06 04:40:34.708410 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 265/552] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:34 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:34.772484 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-be1a0e9c-806c-4c15-b117-2493dbeb408c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:34.773080 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-be1a0e9c-806c-4c15-b117-2493dbeb408c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:34.780634 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be1a0e9c-806c-4c15-b117-2493dbeb408c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:34.784802 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be1a0e9c-806c-4c15-b117-2493dbeb408c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:34.784802 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be1a0e9c-806c-4c15-b117-2493dbeb408c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:34.784802 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be1a0e9c-806c-4c15-b117-2493dbeb408c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:34.784802 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be1a0e9c-806c-4c15-b117-2493dbeb408c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:34.785137 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be1a0e9c-806c-4c15-b117-2493dbeb408c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:34.917905 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-be1a0e9c-806c-4c15-b117-2493dbeb408c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:34.926787 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-be1a0e9c-806c-4c15-b117-2493dbeb408c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:34.928202 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-be1a0e9c-806c-4c15-b117-2493dbeb408c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:34.929365 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-be1a0e9c-806c-4c15-b117-2493dbeb408c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.161038 Sep 06 04:40:34.929915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 288/553] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:34 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:35.731520 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f94da703-4fe4-47fd-aba4-12743541c760 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:35.732143 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f94da703-4fe4-47fd-aba4-12743541c760 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:35.738558 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f94da703-4fe4-47fd-aba4-12743541c760 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:35.739027 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f94da703-4fe4-47fd-aba4-12743541c760 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:35.739448 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f94da703-4fe4-47fd-aba4-12743541c760 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:35.740120 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f94da703-4fe4-47fd-aba4-12743541c760 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:35.740562 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f94da703-4fe4-47fd-aba4-12743541c760 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:35.740976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f94da703-4fe4-47fd-aba4-12743541c760 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:35.805732 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f94da703-4fe4-47fd-aba4-12743541c760 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:35.813182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f94da703-4fe4-47fd-aba4-12743541c760 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.085791 Sep 06 04:40:35.813768 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 266/554] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:35 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:35.956672 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fa7f9a19-a41c-4b56-b537-c81cb98e73b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:35.957355 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fa7f9a19-a41c-4b56-b537-c81cb98e73b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:35.963950 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa7f9a19-a41c-4b56-b537-c81cb98e73b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:35.964433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa7f9a19-a41c-4b56-b537-c81cb98e73b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:35.964865 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa7f9a19-a41c-4b56-b537-c81cb98e73b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:35.965678 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa7f9a19-a41c-4b56-b537-c81cb98e73b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:35.966362 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa7f9a19-a41c-4b56-b537-c81cb98e73b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:35.966800 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa7f9a19-a41c-4b56-b537-c81cb98e73b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:36.096380 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fa7f9a19-a41c-4b56-b537-c81cb98e73b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:36.106211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fa7f9a19-a41c-4b56-b537-c81cb98e73b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:36.108422 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fa7f9a19-a41c-4b56-b537-c81cb98e73b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:36.109728 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fa7f9a19-a41c-4b56-b537-c81cb98e73b4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.157110 Sep 06 04:40:36.110486 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 289/555] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:35 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:36.836056 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f7c22063-277f-4f8c-a2f2-5e6a9c25fb7e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:36.836707 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f7c22063-277f-4f8c-a2f2-5e6a9c25fb7e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:36.843798 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7c22063-277f-4f8c-a2f2-5e6a9c25fb7e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:36.844272 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7c22063-277f-4f8c-a2f2-5e6a9c25fb7e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:36.844698 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7c22063-277f-4f8c-a2f2-5e6a9c25fb7e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:36.845398 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7c22063-277f-4f8c-a2f2-5e6a9c25fb7e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:36.845848 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7c22063-277f-4f8c-a2f2-5e6a9c25fb7e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:36.846263 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7c22063-277f-4f8c-a2f2-5e6a9c25fb7e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:36.912886 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f7c22063-277f-4f8c-a2f2-5e6a9c25fb7e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:36.924086 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f7c22063-277f-4f8c-a2f2-5e6a9c25fb7e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.090764 Sep 06 04:40:36.924086 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 267/556] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:36 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:37.140663 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-db1bbe76-2745-4d20-8d10-c9919a61cb81 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:37.142057 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-db1bbe76-2745-4d20-8d10-c9919a61cb81 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:37.148968 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db1bbe76-2745-4d20-8d10-c9919a61cb81 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:37.149530 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db1bbe76-2745-4d20-8d10-c9919a61cb81 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:37.149960 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db1bbe76-2745-4d20-8d10-c9919a61cb81 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:37.150659 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db1bbe76-2745-4d20-8d10-c9919a61cb81 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:37.151115 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db1bbe76-2745-4d20-8d10-c9919a61cb81 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:37.151538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-db1bbe76-2745-4d20-8d10-c9919a61cb81 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:37.290980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-db1bbe76-2745-4d20-8d10-c9919a61cb81 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:37.299844 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-db1bbe76-2745-4d20-8d10-c9919a61cb81 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:37.301270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-db1bbe76-2745-4d20-8d10-c9919a61cb81 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:37.302557 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-db1bbe76-2745-4d20-8d10-c9919a61cb81 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.170107 Sep 06 04:40:37.303192 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 290/557] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:37 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:37.947527 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3566a6cd-beee-4189-be4b-c54e8340493b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:37.949555 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3566a6cd-beee-4189-be4b-c54e8340493b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:37.957551 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:40:37.958401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:40:37.960769 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3566a6cd-beee-4189-be4b-c54e8340493b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:37.961396 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3566a6cd-beee-4189-be4b-c54e8340493b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:37.961921 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3566a6cd-beee-4189-be4b-c54e8340493b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:37.962758 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3566a6cd-beee-4189-be4b-c54e8340493b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:37.963313 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3566a6cd-beee-4189-be4b-c54e8340493b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:37.963831 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3566a6cd-beee-4189-be4b-c54e8340493b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:38.030557 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3566a6cd-beee-4189-be4b-c54e8340493b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:38.038472 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3566a6cd-beee-4189-be4b-c54e8340493b tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.095530 Sep 06 04:40:38.039241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 268/558] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:37 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:38.384126 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d4f58d3e-8467-46d4-b40a-de5d1d163e70 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:38.384126 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d4f58d3e-8467-46d4-b40a-de5d1d163e70 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:38.384126 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:40:38.384126 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4f58d3e-8467-46d4-b40a-de5d1d163e70 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:38.384126 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4f58d3e-8467-46d4-b40a-de5d1d163e70 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:38.385163 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4f58d3e-8467-46d4-b40a-de5d1d163e70 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:38.385163 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4f58d3e-8467-46d4-b40a-de5d1d163e70 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:38.385163 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4f58d3e-8467-46d4-b40a-de5d1d163e70 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:38.385163 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4f58d3e-8467-46d4-b40a-de5d1d163e70 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:38.478314 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d4f58d3e-8467-46d4-b40a-de5d1d163e70 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:38.486950 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d4f58d3e-8467-46d4-b40a-de5d1d163e70 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:38.488391 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d4f58d3e-8467-46d4-b40a-de5d1d163e70 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:38.489572 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d4f58d3e-8467-46d4-b40a-de5d1d163e70 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.166432 Sep 06 04:40:38.490137 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 291/559] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:38 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:39.063905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ef08532f-f270-4d91-8de2-eebce9372e4c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:39.064711 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ef08532f-f270-4d91-8de2-eebce9372e4c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:39.073683 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef08532f-f270-4d91-8de2-eebce9372e4c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:39.074392 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef08532f-f270-4d91-8de2-eebce9372e4c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:39.075069 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef08532f-f270-4d91-8de2-eebce9372e4c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:39.075912 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef08532f-f270-4d91-8de2-eebce9372e4c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:39.076437 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef08532f-f270-4d91-8de2-eebce9372e4c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:39.076965 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef08532f-f270-4d91-8de2-eebce9372e4c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:39.137127 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ef08532f-f270-4d91-8de2-eebce9372e4c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:39.145506 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ef08532f-f270-4d91-8de2-eebce9372e4c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.085820 Sep 06 04:40:39.146070 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 269/560] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:39 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:39.516446 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e96135da-dbf1-4704-ab4e-05ddd769fee5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:39.517045 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e96135da-dbf1-4704-ab4e-05ddd769fee5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:39.519390 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=60 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:40:39.524045 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e96135da-dbf1-4704-ab4e-05ddd769fee5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:39.524518 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e96135da-dbf1-4704-ab4e-05ddd769fee5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:39.524949 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e96135da-dbf1-4704-ab4e-05ddd769fee5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:39.525658 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e96135da-dbf1-4704-ab4e-05ddd769fee5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:39.526109 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e96135da-dbf1-4704-ab4e-05ddd769fee5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:39.526529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e96135da-dbf1-4704-ab4e-05ddd769fee5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:39.667365 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e96135da-dbf1-4704-ab4e-05ddd769fee5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:39.684999 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e96135da-dbf1-4704-ab4e-05ddd769fee5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:39.686949 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e96135da-dbf1-4704-ab4e-05ddd769fee5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:39.688225 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e96135da-dbf1-4704-ab4e-05ddd769fee5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.176627 Sep 06 04:40:39.688765 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 292/561] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:39 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:40.168372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b163cf06-ebb7-4362-bb80-127cd9611961 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:40.168913 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b163cf06-ebb7-4362-bb80-127cd9611961 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:40.176129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b163cf06-ebb7-4362-bb80-127cd9611961 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:40.176613 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b163cf06-ebb7-4362-bb80-127cd9611961 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:40.177049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b163cf06-ebb7-4362-bb80-127cd9611961 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:40.177767 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b163cf06-ebb7-4362-bb80-127cd9611961 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:40.178223 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b163cf06-ebb7-4362-bb80-127cd9611961 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:40.178646 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b163cf06-ebb7-4362-bb80-127cd9611961 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:40.242592 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b163cf06-ebb7-4362-bb80-127cd9611961 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:40.251091 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b163cf06-ebb7-4362-bb80-127cd9611961 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.086602 Sep 06 04:40:40.251662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 270/562] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:40 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:40.713892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-27921933-4b57-402d-bfbd-529334a3820f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:40.714557 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-27921933-4b57-402d-bfbd-529334a3820f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:40.721580 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27921933-4b57-402d-bfbd-529334a3820f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:40.722053 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27921933-4b57-402d-bfbd-529334a3820f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:40.722479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27921933-4b57-402d-bfbd-529334a3820f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:40.723151 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27921933-4b57-402d-bfbd-529334a3820f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:40.723596 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27921933-4b57-402d-bfbd-529334a3820f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:40.724010 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27921933-4b57-402d-bfbd-529334a3820f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:40.856447 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-27921933-4b57-402d-bfbd-529334a3820f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:40.865090 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-27921933-4b57-402d-bfbd-529334a3820f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:40.866688 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-27921933-4b57-402d-bfbd-529334a3820f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:40.867846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-27921933-4b57-402d-bfbd-529334a3820f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.157788 Sep 06 04:40:40.868405 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 293/563] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:40 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:41.273523 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c7b3375e-d22f-42ed-a083-15d03df9baeb tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:41.274129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c7b3375e-d22f-42ed-a083-15d03df9baeb tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:41.281750 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7b3375e-d22f-42ed-a083-15d03df9baeb tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:41.282241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7b3375e-d22f-42ed-a083-15d03df9baeb tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:41.282678 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7b3375e-d22f-42ed-a083-15d03df9baeb tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:41.283370 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7b3375e-d22f-42ed-a083-15d03df9baeb tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:41.283821 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7b3375e-d22f-42ed-a083-15d03df9baeb tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:41.284241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7b3375e-d22f-42ed-a083-15d03df9baeb tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:41.346791 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c7b3375e-d22f-42ed-a083-15d03df9baeb tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:41.354170 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c7b3375e-d22f-42ed-a083-15d03df9baeb tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.084565 Sep 06 04:40:41.354732 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 271/564] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:41 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:41.893561 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9b6e5f29-5546-4ddf-b870-22f90b73b9a1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:41.894162 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9b6e5f29-5546-4ddf-b870-22f90b73b9a1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:41.900637 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b6e5f29-5546-4ddf-b870-22f90b73b9a1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:41.901113 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b6e5f29-5546-4ddf-b870-22f90b73b9a1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:41.901583 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b6e5f29-5546-4ddf-b870-22f90b73b9a1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:41.902530 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b6e5f29-5546-4ddf-b870-22f90b73b9a1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:41.902982 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b6e5f29-5546-4ddf-b870-22f90b73b9a1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:41.903401 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b6e5f29-5546-4ddf-b870-22f90b73b9a1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:42.034494 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9b6e5f29-5546-4ddf-b870-22f90b73b9a1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:42.043057 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9b6e5f29-5546-4ddf-b870-22f90b73b9a1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:42.044463 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9b6e5f29-5546-4ddf-b870-22f90b73b9a1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:42.046319 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9b6e5f29-5546-4ddf-b870-22f90b73b9a1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.156156 Sep 06 04:40:42.046881 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 294/565] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:41 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:42.377871 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-48a80986-26e3-4ae2-8a4d-e8038548722c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:42.378475 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-48a80986-26e3-4ae2-8a4d-e8038548722c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:42.384921 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48a80986-26e3-4ae2-8a4d-e8038548722c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:42.385906 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48a80986-26e3-4ae2-8a4d-e8038548722c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:42.385906 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48a80986-26e3-4ae2-8a4d-e8038548722c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:42.386514 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48a80986-26e3-4ae2-8a4d-e8038548722c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:42.386956 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48a80986-26e3-4ae2-8a4d-e8038548722c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:42.387371 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48a80986-26e3-4ae2-8a4d-e8038548722c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:42.449247 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-48a80986-26e3-4ae2-8a4d-e8038548722c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:42.457878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-48a80986-26e3-4ae2-8a4d-e8038548722c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.083812 Sep 06 04:40:42.458446 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 272/566] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:42 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:43.070768 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d0c97b36-8232-4b5e-a6a5-4bc781eef389 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:43.071365 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d0c97b36-8232-4b5e-a6a5-4bc781eef389 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:43.077730 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d0c97b36-8232-4b5e-a6a5-4bc781eef389 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:43.078205 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d0c97b36-8232-4b5e-a6a5-4bc781eef389 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:43.078631 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d0c97b36-8232-4b5e-a6a5-4bc781eef389 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:43.079306 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d0c97b36-8232-4b5e-a6a5-4bc781eef389 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:43.079751 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d0c97b36-8232-4b5e-a6a5-4bc781eef389 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:43.080164 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d0c97b36-8232-4b5e-a6a5-4bc781eef389 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:43.208028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d0c97b36-8232-4b5e-a6a5-4bc781eef389 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:43.216872 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d0c97b36-8232-4b5e-a6a5-4bc781eef389 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:43.218979 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d0c97b36-8232-4b5e-a6a5-4bc781eef389 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:43.220115 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d0c97b36-8232-4b5e-a6a5-4bc781eef389 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.153218 Sep 06 04:40:43.220670 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 295/567] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:43 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:43.481299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-84e92df4-5543-4a45-abdf-2d98af6aed16 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:43.481928 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-84e92df4-5543-4a45-abdf-2d98af6aed16 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:43.484392 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:40:43.489036 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84e92df4-5543-4a45-abdf-2d98af6aed16 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:43.489543 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84e92df4-5543-4a45-abdf-2d98af6aed16 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:43.489974 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84e92df4-5543-4a45-abdf-2d98af6aed16 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:43.490647 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84e92df4-5543-4a45-abdf-2d98af6aed16 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:43.491089 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84e92df4-5543-4a45-abdf-2d98af6aed16 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:43.491500 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84e92df4-5543-4a45-abdf-2d98af6aed16 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:43.551062 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-84e92df4-5543-4a45-abdf-2d98af6aed16 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:43.558659 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-84e92df4-5543-4a45-abdf-2d98af6aed16 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.081144 Sep 06 04:40:43.559243 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 273/568] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:43 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:44.245097 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2bfb0886-d829-4fdd-a785-85af79121f6c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:44.245739 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2bfb0886-d829-4fdd-a785-85af79121f6c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:44.252317 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bfb0886-d829-4fdd-a785-85af79121f6c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:44.252814 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bfb0886-d829-4fdd-a785-85af79121f6c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:44.253263 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bfb0886-d829-4fdd-a785-85af79121f6c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:44.253972 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bfb0886-d829-4fdd-a785-85af79121f6c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:44.254432 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bfb0886-d829-4fdd-a785-85af79121f6c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:44.254909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2bfb0886-d829-4fdd-a785-85af79121f6c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:44.388736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2bfb0886-d829-4fdd-a785-85af79121f6c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:44.397479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2bfb0886-d829-4fdd-a785-85af79121f6c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:44.398916 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2bfb0886-d829-4fdd-a785-85af79121f6c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:44.400088 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2bfb0886-d829-4fdd-a785-85af79121f6c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.158906 Sep 06 04:40:44.400643 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 296/569] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:44 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:44.582515 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ac77ee44-b476-4641-8c37-278a4862f546 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:44.583120 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ac77ee44-b476-4641-8c37-278a4862f546 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:44.589924 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac77ee44-b476-4641-8c37-278a4862f546 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:44.590397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac77ee44-b476-4641-8c37-278a4862f546 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:44.590826 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac77ee44-b476-4641-8c37-278a4862f546 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:44.591501 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac77ee44-b476-4641-8c37-278a4862f546 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:44.591947 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac77ee44-b476-4641-8c37-278a4862f546 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:44.592983 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac77ee44-b476-4641-8c37-278a4862f546 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:44.654226 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ac77ee44-b476-4641-8c37-278a4862f546 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:44.662409 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ac77ee44-b476-4641-8c37-278a4862f546 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.083702 Sep 06 04:40:44.662975 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 274/570] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:44 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:45.426450 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e79339f6-c2e0-48cb-b8ad-60a78fc2eec4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:45.427052 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e79339f6-c2e0-48cb-b8ad-60a78fc2eec4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:45.433414 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e79339f6-c2e0-48cb-b8ad-60a78fc2eec4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:45.433885 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e79339f6-c2e0-48cb-b8ad-60a78fc2eec4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:45.434310 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e79339f6-c2e0-48cb-b8ad-60a78fc2eec4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:45.434977 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e79339f6-c2e0-48cb-b8ad-60a78fc2eec4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:45.435422 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e79339f6-c2e0-48cb-b8ad-60a78fc2eec4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:45.435838 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e79339f6-c2e0-48cb-b8ad-60a78fc2eec4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:45.684915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-89c5c266-a7aa-41fa-a36e-ece1faa369d1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:45.685505 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-89c5c266-a7aa-41fa-a36e-ece1faa369d1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:45.692873 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-89c5c266-a7aa-41fa-a36e-ece1faa369d1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:45.693412 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-89c5c266-a7aa-41fa-a36e-ece1faa369d1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:45.693816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-89c5c266-a7aa-41fa-a36e-ece1faa369d1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:45.694578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-89c5c266-a7aa-41fa-a36e-ece1faa369d1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:45.694954 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-89c5c266-a7aa-41fa-a36e-ece1faa369d1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:45.695360 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-89c5c266-a7aa-41fa-a36e-ece1faa369d1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:45.756439 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-89c5c266-a7aa-41fa-a36e-ece1faa369d1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:45.764024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-89c5c266-a7aa-41fa-a36e-ece1faa369d1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1223 microversion: 2.1 time: 0.083321 Sep 06 04:40:45.764593 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 275/571] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:45 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:40:45.775943 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e79339f6-c2e0-48cb-b8ad-60a78fc2eec4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:45.778401 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:40:45.785901 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e79339f6-c2e0-48cb-b8ad-60a78fc2eec4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:45.787323 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e79339f6-c2e0-48cb-b8ad-60a78fc2eec4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:45.788496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e79339f6-c2e0-48cb-b8ad-60a78fc2eec4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.365898 Sep 06 04:40:45.789046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 297/572] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:45 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:46.787062 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a8b596f7-84f5-411b-9bae-0ee9d028c448 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:46.787593 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a8b596f7-84f5-411b-9bae-0ee9d028c448 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:46.793918 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8b596f7-84f5-411b-9bae-0ee9d028c448 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:46.794394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8b596f7-84f5-411b-9bae-0ee9d028c448 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:46.794820 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8b596f7-84f5-411b-9bae-0ee9d028c448 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:46.795538 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8b596f7-84f5-411b-9bae-0ee9d028c448 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:46.795979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8b596f7-84f5-411b-9bae-0ee9d028c448 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:46.796391 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a8b596f7-84f5-411b-9bae-0ee9d028c448 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:46.818522 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-622cf7ee-fe43-4ba7-b3a1-ae33fc6fa584 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:46.819124 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-622cf7ee-fe43-4ba7-b3a1-ae33fc6fa584 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:46.825636 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-622cf7ee-fe43-4ba7-b3a1-ae33fc6fa584 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:46.826120 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-622cf7ee-fe43-4ba7-b3a1-ae33fc6fa584 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:46.826550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-622cf7ee-fe43-4ba7-b3a1-ae33fc6fa584 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:46.827853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-622cf7ee-fe43-4ba7-b3a1-ae33fc6fa584 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:46.828305 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-622cf7ee-fe43-4ba7-b3a1-ae33fc6fa584 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:46.828727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-622cf7ee-fe43-4ba7-b3a1-ae33fc6fa584 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:46.857142 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a8b596f7-84f5-411b-9bae-0ee9d028c448 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:46.864983 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a8b596f7-84f5-411b-9bae-0ee9d028c448 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1271 microversion: 2.1 time: 0.081777 Sep 06 04:40:46.865581 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 276/573] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:46 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:46.958594 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-622cf7ee-fe43-4ba7-b3a1-ae33fc6fa584 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:46.967205 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-622cf7ee-fe43-4ba7-b3a1-ae33fc6fa584 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:46.969186 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-622cf7ee-fe43-4ba7-b3a1-ae33fc6fa584 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:46.970402 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-622cf7ee-fe43-4ba7-b3a1-ae33fc6fa584 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.156152 Sep 06 04:40:46.970959 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 298/574] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:46 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:40:47.888003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-018d8287-719a-402f-a9ed-1a7fe79be018 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:47.891039 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-018d8287-719a-402f-a9ed-1a7fe79be018 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:47.898526 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-018d8287-719a-402f-a9ed-1a7fe79be018 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:47.899283 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-018d8287-719a-402f-a9ed-1a7fe79be018 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:47.899944 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-018d8287-719a-402f-a9ed-1a7fe79be018 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:47.900916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-018d8287-719a-402f-a9ed-1a7fe79be018 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:47.901262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-018d8287-719a-402f-a9ed-1a7fe79be018 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:47.902214 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-018d8287-719a-402f-a9ed-1a7fe79be018 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:47.977697 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-018d8287-719a-402f-a9ed-1a7fe79be018 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:47.986498 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-018d8287-719a-402f-a9ed-1a7fe79be018 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1289 microversion: 2.1 time: 0.102304 Sep 06 04:40:48.001526 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 277/575] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:47 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:48.001884 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9fb5b192-ff1d-454b-8dc3-1c04f34746f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:48.001884 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9fb5b192-ff1d-454b-8dc3-1c04f34746f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:48.002390 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9fb5b192-ff1d-454b-8dc3-1c04f34746f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:48.002887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9fb5b192-ff1d-454b-8dc3-1c04f34746f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:48.003261 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9fb5b192-ff1d-454b-8dc3-1c04f34746f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:48.003951 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9fb5b192-ff1d-454b-8dc3-1c04f34746f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:48.004409 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9fb5b192-ff1d-454b-8dc3-1c04f34746f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:48.004886 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9fb5b192-ff1d-454b-8dc3-1c04f34746f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:48.136488 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9fb5b192-ff1d-454b-8dc3-1c04f34746f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:48.146130 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9fb5b192-ff1d-454b-8dc3-1c04f34746f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:48.147623 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9fb5b192-ff1d-454b-8dc3-1c04f34746f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:48.148782 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9fb5b192-ff1d-454b-8dc3-1c04f34746f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.157803 Sep 06 04:40:48.149350 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 299/576] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:47 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:49.014010 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e387b097-91b6-4829-b9a3-a0c4010aee22 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:49.039012 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e387b097-91b6-4829-b9a3-a0c4010aee22 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:49.039012 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e387b097-91b6-4829-b9a3-a0c4010aee22 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:49.039012 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e387b097-91b6-4829-b9a3-a0c4010aee22 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:49.039012 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e387b097-91b6-4829-b9a3-a0c4010aee22 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:49.039716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e387b097-91b6-4829-b9a3-a0c4010aee22 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:49.039716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e387b097-91b6-4829-b9a3-a0c4010aee22 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:49.039716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e387b097-91b6-4829-b9a3-a0c4010aee22 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:49.175146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0c316e80-fdf4-4d65-a661-2e003b391775 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:49.175758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0c316e80-fdf4-4d65-a661-2e003b391775 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:49.182096 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c316e80-fdf4-4d65-a661-2e003b391775 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:49.182588 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c316e80-fdf4-4d65-a661-2e003b391775 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:49.183023 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c316e80-fdf4-4d65-a661-2e003b391775 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:49.183712 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c316e80-fdf4-4d65-a661-2e003b391775 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:49.184170 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c316e80-fdf4-4d65-a661-2e003b391775 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:49.184596 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c316e80-fdf4-4d65-a661-2e003b391775 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:49.219100 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e387b097-91b6-4829-b9a3-a0c4010aee22 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:49.227438 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e387b097-91b6-4829-b9a3-a0c4010aee22 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1319 microversion: 2.1 time: 0.217267 Sep 06 04:40:49.231433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 278/577] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:49 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:49.318871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0c316e80-fdf4-4d65-a661-2e003b391775 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:49.327859 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0c316e80-fdf4-4d65-a661-2e003b391775 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:49.329285 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0c316e80-fdf4-4d65-a661-2e003b391775 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:49.330460 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0c316e80-fdf4-4d65-a661-2e003b391775 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.160004 Sep 06 04:40:49.331026 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 300/578] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:49 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:40:49.369768 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-bac6b9bd-e3fb-4017-972f-9de7265f9599 req-ac0c4c45-42aa-4212-83b1-b570564dac26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe", "tag": "a0ca313c-cb22-419f-a33b-5f2b11961726"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:40:49.382635 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-bac6b9bd-e3fb-4017-972f-9de7265f9599 req-ac0c4c45-42aa-4212-83b1-b570564dac26 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:49.383247 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-bac6b9bd-e3fb-4017-972f-9de7265f9599 req-ac0c4c45-42aa-4212-83b1-b570564dac26 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:49.385807 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-bac6b9bd-e3fb-4017-972f-9de7265f9599 req-ac0c4c45-42aa-4212-83b1-b570564dac26 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:49.398717 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-bac6b9bd-e3fb-4017-972f-9de7265f9599 req-ac0c4c45-42aa-4212-83b1-b570564dac26 service nova] Creating event network-changed:a0ca313c-cb22-419f-a33b-5f2b11961726 for instance 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe on hv-cinder-85600 Sep 06 04:40:49.404201 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-bac6b9bd-e3fb-4017-972f-9de7265f9599 req-ac0c4c45-42aa-4212-83b1-b570564dac26 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038364 Sep 06 04:40:49.405897 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 279/579] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:40:50.251520 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-60698c72-f54b-4bec-9790-5f7a0c0856ad tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:50.252120 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-60698c72-f54b-4bec-9790-5f7a0c0856ad tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:50.258595 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60698c72-f54b-4bec-9790-5f7a0c0856ad tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:50.259072 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60698c72-f54b-4bec-9790-5f7a0c0856ad tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:50.259500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60698c72-f54b-4bec-9790-5f7a0c0856ad tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:50.260173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60698c72-f54b-4bec-9790-5f7a0c0856ad tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:50.260662 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60698c72-f54b-4bec-9790-5f7a0c0856ad tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:50.261065 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-60698c72-f54b-4bec-9790-5f7a0c0856ad tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:50.357068 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7c4fa440-e1ec-4ef2-9f8c-c998546a9388 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:50.357998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7c4fa440-e1ec-4ef2-9f8c-c998546a9388 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:50.365600 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c4fa440-e1ec-4ef2-9f8c-c998546a9388 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:50.365778 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c4fa440-e1ec-4ef2-9f8c-c998546a9388 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:50.366147 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c4fa440-e1ec-4ef2-9f8c-c998546a9388 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:50.366902 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c4fa440-e1ec-4ef2-9f8c-c998546a9388 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:50.367501 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c4fa440-e1ec-4ef2-9f8c-c998546a9388 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:50.367930 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c4fa440-e1ec-4ef2-9f8c-c998546a9388 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:50.390738 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-60698c72-f54b-4bec-9790-5f7a0c0856ad tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:50.398475 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-60698c72-f54b-4bec-9790-5f7a0c0856ad tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1319 microversion: 2.1 time: 0.150835 Sep 06 04:40:50.399126 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 301/580] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:50 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:50.507613 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7c4fa440-e1ec-4ef2-9f8c-c998546a9388 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:50.517125 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7c4fa440-e1ec-4ef2-9f8c-c998546a9388 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:50.518586 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7c4fa440-e1ec-4ef2-9f8c-c998546a9388 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:50.519733 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7c4fa440-e1ec-4ef2-9f8c-c998546a9388 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.167449 Sep 06 04:40:50.520300 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 280/581] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:50 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:40:51.422086 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f5041a0f-221f-4643-a25e-5ff28d5342de tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:51.422712 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f5041a0f-221f-4643-a25e-5ff28d5342de tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:51.429166 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5041a0f-221f-4643-a25e-5ff28d5342de tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:51.429672 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5041a0f-221f-4643-a25e-5ff28d5342de tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:51.430104 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5041a0f-221f-4643-a25e-5ff28d5342de tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:51.430808 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5041a0f-221f-4643-a25e-5ff28d5342de tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:51.431255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5041a0f-221f-4643-a25e-5ff28d5342de tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:51.431674 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f5041a0f-221f-4643-a25e-5ff28d5342de tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:51.545812 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d15b0048-9377-4434-b48d-755fb39ed306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:51.546421 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d15b0048-9377-4434-b48d-755fb39ed306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:51.553000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d15b0048-9377-4434-b48d-755fb39ed306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:51.553509 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d15b0048-9377-4434-b48d-755fb39ed306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:51.553937 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d15b0048-9377-4434-b48d-755fb39ed306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:51.554636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d15b0048-9377-4434-b48d-755fb39ed306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:51.555060 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d15b0048-9377-4434-b48d-755fb39ed306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:51.555474 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d15b0048-9377-4434-b48d-755fb39ed306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:51.560933 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f5041a0f-221f-4643-a25e-5ff28d5342de tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:51.568841 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f5041a0f-221f-4643-a25e-5ff28d5342de tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1319 microversion: 2.1 time: 0.150698 Sep 06 04:40:51.569414 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 302/582] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:51 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:51.570538 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:40:51.686854 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d15b0048-9377-4434-b48d-755fb39ed306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:51.695415 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d15b0048-9377-4434-b48d-755fb39ed306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:51.696852 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d15b0048-9377-4434-b48d-755fb39ed306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:51.698040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d15b0048-9377-4434-b48d-755fb39ed306 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.156079 Sep 06 04:40:51.698601 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 281/583] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:51 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:40:52.592190 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-208669a2-00b5-4863-ac29-53964e97dc0c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:52.592916 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-208669a2-00b5-4863-ac29-53964e97dc0c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:52.599355 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-208669a2-00b5-4863-ac29-53964e97dc0c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:52.599830 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-208669a2-00b5-4863-ac29-53964e97dc0c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:52.600260 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-208669a2-00b5-4863-ac29-53964e97dc0c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:52.600939 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-208669a2-00b5-4863-ac29-53964e97dc0c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:52.601417 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-208669a2-00b5-4863-ac29-53964e97dc0c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:52.601837 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-208669a2-00b5-4863-ac29-53964e97dc0c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:52.723028 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c198708a-3af3-4bef-8ee5-64da670ce287 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:52.723648 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c198708a-3af3-4bef-8ee5-64da670ce287 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:52.730034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c198708a-3af3-4bef-8ee5-64da670ce287 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:52.730521 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c198708a-3af3-4bef-8ee5-64da670ce287 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:52.730957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c198708a-3af3-4bef-8ee5-64da670ce287 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:52.731652 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c198708a-3af3-4bef-8ee5-64da670ce287 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:52.732106 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c198708a-3af3-4bef-8ee5-64da670ce287 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:52.732535 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c198708a-3af3-4bef-8ee5-64da670ce287 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:52.736440 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-208669a2-00b5-4863-ac29-53964e97dc0c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:52.744127 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-208669a2-00b5-4863-ac29-53964e97dc0c tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1319 microversion: 2.1 time: 0.155824 Sep 06 04:40:52.744700 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 303/584] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:52 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:52.862467 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c198708a-3af3-4bef-8ee5-64da670ce287 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:52.870947 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c198708a-3af3-4bef-8ee5-64da670ce287 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:52.874095 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c198708a-3af3-4bef-8ee5-64da670ce287 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:52.874095 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c198708a-3af3-4bef-8ee5-64da670ce287 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.154373 Sep 06 04:40:52.874347 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 282/585] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:52 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:40:53.767782 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d05e9399-8761-48ed-a897-b9e54ac3f1e5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:53.768313 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d05e9399-8761-48ed-a897-b9e54ac3f1e5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:53.774700 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d05e9399-8761-48ed-a897-b9e54ac3f1e5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:53.775173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d05e9399-8761-48ed-a897-b9e54ac3f1e5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:53.775598 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d05e9399-8761-48ed-a897-b9e54ac3f1e5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:53.776270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d05e9399-8761-48ed-a897-b9e54ac3f1e5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:53.776714 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d05e9399-8761-48ed-a897-b9e54ac3f1e5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:53.777424 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d05e9399-8761-48ed-a897-b9e54ac3f1e5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:53.899282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ace34613-d0e2-4586-85de-db8faa588ea5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:53.899898 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ace34613-d0e2-4586-85de-db8faa588ea5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:53.907202 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ace34613-d0e2-4586-85de-db8faa588ea5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:53.907688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ace34613-d0e2-4586-85de-db8faa588ea5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:53.907803 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d05e9399-8761-48ed-a897-b9e54ac3f1e5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:53.908130 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ace34613-d0e2-4586-85de-db8faa588ea5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:53.908826 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ace34613-d0e2-4586-85de-db8faa588ea5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:53.909276 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ace34613-d0e2-4586-85de-db8faa588ea5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:53.909730 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ace34613-d0e2-4586-85de-db8faa588ea5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:53.915352 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d05e9399-8761-48ed-a897-b9e54ac3f1e5 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1319 microversion: 2.1 time: 0.151649 Sep 06 04:40:53.915917 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 304/586] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:53 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:54.034932 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ace34613-d0e2-4586-85de-db8faa588ea5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:54.043359 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ace34613-d0e2-4586-85de-db8faa588ea5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:54.044792 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ace34613-d0e2-4586-85de-db8faa588ea5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:54.046062 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ace34613-d0e2-4586-85de-db8faa588ea5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.150712 Sep 06 04:40:54.046710 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 283/587] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:53 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:40:54.938755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a8a8f9c0-e6c1-45f4-ba71-8bec00cf7d41 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:54.939351 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a8a8f9c0-e6c1-45f4-ba71-8bec00cf7d41 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:54.945925 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8a8f9c0-e6c1-45f4-ba71-8bec00cf7d41 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:54.946405 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8a8f9c0-e6c1-45f4-ba71-8bec00cf7d41 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:54.946840 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8a8f9c0-e6c1-45f4-ba71-8bec00cf7d41 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:54.947514 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8a8f9c0-e6c1-45f4-ba71-8bec00cf7d41 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:54.947961 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8a8f9c0-e6c1-45f4-ba71-8bec00cf7d41 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:54.948376 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8a8f9c0-e6c1-45f4-ba71-8bec00cf7d41 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:55.071874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d17f6fc8-3b2a-43c7-9a01-5dc276ba9573 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:55.072493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d17f6fc8-3b2a-43c7-9a01-5dc276ba9573 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:55.076594 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a8a8f9c0-e6c1-45f4-ba71-8bec00cf7d41 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:55.078992 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17f6fc8-3b2a-43c7-9a01-5dc276ba9573 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:55.079476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17f6fc8-3b2a-43c7-9a01-5dc276ba9573 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:55.079905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17f6fc8-3b2a-43c7-9a01-5dc276ba9573 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:55.080589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17f6fc8-3b2a-43c7-9a01-5dc276ba9573 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:55.081033 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17f6fc8-3b2a-43c7-9a01-5dc276ba9573 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:55.081476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d17f6fc8-3b2a-43c7-9a01-5dc276ba9573 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:55.085047 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a8a8f9c0-e6c1-45f4-ba71-8bec00cf7d41 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1319 microversion: 2.1 time: 0.150320 Sep 06 04:40:55.085649 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 305/588] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:54 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:55.208017 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d17f6fc8-3b2a-43c7-9a01-5dc276ba9573 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:55.216586 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d17f6fc8-3b2a-43c7-9a01-5dc276ba9573 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:55.218241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d17f6fc8-3b2a-43c7-9a01-5dc276ba9573 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:55.219395 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d17f6fc8-3b2a-43c7-9a01-5dc276ba9573 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.151363 Sep 06 04:40:55.219959 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 284/589] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:55 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:40:56.107875 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8ebf4217-b13a-45e7-849a-4accd625f811 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:56.109078 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8ebf4217-b13a-45e7-849a-4accd625f811 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:56.115452 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ebf4217-b13a-45e7-849a-4accd625f811 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:56.115923 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ebf4217-b13a-45e7-849a-4accd625f811 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:56.116352 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ebf4217-b13a-45e7-849a-4accd625f811 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:56.117025 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ebf4217-b13a-45e7-849a-4accd625f811 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:56.117501 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ebf4217-b13a-45e7-849a-4accd625f811 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:56.117916 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8ebf4217-b13a-45e7-849a-4accd625f811 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:56.245041 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-128d9508-e335-4af5-931a-67fcfdd3c0b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:56.245679 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-128d9508-e335-4af5-931a-67fcfdd3c0b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:56.246833 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8ebf4217-b13a-45e7-849a-4accd625f811 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:56.253592 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-128d9508-e335-4af5-931a-67fcfdd3c0b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:56.254077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-128d9508-e335-4af5-931a-67fcfdd3c0b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:56.254509 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-128d9508-e335-4af5-931a-67fcfdd3c0b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:56.255201 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-128d9508-e335-4af5-931a-67fcfdd3c0b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:56.255358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8ebf4217-b13a-45e7-849a-4accd625f811 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1319 microversion: 2.1 time: 0.151228 Sep 06 04:40:56.255645 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-128d9508-e335-4af5-931a-67fcfdd3c0b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:56.255936 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 306/590] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:56 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:56.256069 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-128d9508-e335-4af5-931a-67fcfdd3c0b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:56.389048 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-128d9508-e335-4af5-931a-67fcfdd3c0b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:56.398664 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-128d9508-e335-4af5-931a-67fcfdd3c0b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:56.400097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-128d9508-e335-4af5-931a-67fcfdd3c0b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:56.401323 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-128d9508-e335-4af5-931a-67fcfdd3c0b9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.160235 Sep 06 04:40:56.402138 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 285/591] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:56 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:57.279101 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-70052adc-a2a3-421e-95a1-d614686a4384 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:57.279704 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-70052adc-a2a3-421e-95a1-d614686a4384 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:57.286197 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70052adc-a2a3-421e-95a1-d614686a4384 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:57.286678 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70052adc-a2a3-421e-95a1-d614686a4384 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:57.287110 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70052adc-a2a3-421e-95a1-d614686a4384 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:57.287791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70052adc-a2a3-421e-95a1-d614686a4384 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:57.288240 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70052adc-a2a3-421e-95a1-d614686a4384 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:57.288661 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70052adc-a2a3-421e-95a1-d614686a4384 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:57.421468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-70052adc-a2a3-421e-95a1-d614686a4384 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:57.427366 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0896864d-a467-4401-ae8f-db8f541bf471 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:57.427981 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0896864d-a467-4401-ae8f-db8f541bf471 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:57.429319 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-70052adc-a2a3-421e-95a1-d614686a4384 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1319 microversion: 2.1 time: 0.154325 Sep 06 04:40:57.429894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 307/592] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:57 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:57.434176 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0896864d-a467-4401-ae8f-db8f541bf471 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:57.434660 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0896864d-a467-4401-ae8f-db8f541bf471 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:57.435101 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0896864d-a467-4401-ae8f-db8f541bf471 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:57.435796 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0896864d-a467-4401-ae8f-db8f541bf471 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:57.436850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0896864d-a467-4401-ae8f-db8f541bf471 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:57.437390 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0896864d-a467-4401-ae8f-db8f541bf471 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:57.562870 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0896864d-a467-4401-ae8f-db8f541bf471 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:57.571419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0896864d-a467-4401-ae8f-db8f541bf471 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:57.572852 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0896864d-a467-4401-ae8f-db8f541bf471 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:57.574061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0896864d-a467-4401-ae8f-db8f541bf471 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.150541 Sep 06 04:40:57.574621 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 286/593] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:57 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:40:58.235580 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-f97baeb0-eec1-4ca2-81db-05947c29391e req-12d2890c-8ede-4057-97be-30f22220198f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe", "name": "network-vif-plugged", "status": "completed", "tag": "a0ca313c-cb22-419f-a33b-5f2b11961726"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:40:58.245652 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-f97baeb0-eec1-4ca2-81db-05947c29391e req-12d2890c-8ede-4057-97be-30f22220198f service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:58.246476 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-f97baeb0-eec1-4ca2-81db-05947c29391e req-12d2890c-8ede-4057-97be-30f22220198f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:58.246970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-f97baeb0-eec1-4ca2-81db-05947c29391e req-12d2890c-8ede-4057-97be-30f22220198f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:58.259287 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-f97baeb0-eec1-4ca2-81db-05947c29391e req-12d2890c-8ede-4057-97be-30f22220198f service nova] Creating event network-vif-plugged:a0ca313c-cb22-419f-a33b-5f2b11961726 for instance 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe on hv-cinder-85600 Sep 06 04:40:58.264699 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-f97baeb0-eec1-4ca2-81db-05947c29391e req-12d2890c-8ede-4057-97be-30f22220198f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033348 Sep 06 04:40:58.267755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 308/594] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:40:58.454429 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-48cf06f9-1a30-4abc-affd-dc4c1a232cb6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:58.455041 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-48cf06f9-1a30-4abc-affd-dc4c1a232cb6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:58.462797 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48cf06f9-1a30-4abc-affd-dc4c1a232cb6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:58.463279 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48cf06f9-1a30-4abc-affd-dc4c1a232cb6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:58.463708 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48cf06f9-1a30-4abc-affd-dc4c1a232cb6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:58.464458 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48cf06f9-1a30-4abc-affd-dc4c1a232cb6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:58.466306 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48cf06f9-1a30-4abc-affd-dc4c1a232cb6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:58.466742 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-48cf06f9-1a30-4abc-affd-dc4c1a232cb6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:58.601259 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7e5ee886-c506-431f-aff1-2edde56b0771 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:58.602506 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7e5ee886-c506-431f-aff1-2edde56b0771 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:58.609414 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e5ee886-c506-431f-aff1-2edde56b0771 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:58.609906 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e5ee886-c506-431f-aff1-2edde56b0771 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:58.610388 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e5ee886-c506-431f-aff1-2edde56b0771 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:58.611089 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e5ee886-c506-431f-aff1-2edde56b0771 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:58.611541 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e5ee886-c506-431f-aff1-2edde56b0771 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:58.611960 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7e5ee886-c506-431f-aff1-2edde56b0771 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:58.642266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-48cf06f9-1a30-4abc-affd-dc4c1a232cb6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:58.650176 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-48cf06f9-1a30-4abc-affd-dc4c1a232cb6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1319 microversion: 2.1 time: 0.202003 Sep 06 04:40:58.655757 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 287/595] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:58 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:58.778778 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7e5ee886-c506-431f-aff1-2edde56b0771 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:58.791687 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7e5ee886-c506-431f-aff1-2edde56b0771 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:58.793186 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7e5ee886-c506-431f-aff1-2edde56b0771 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:58.794384 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7e5ee886-c506-431f-aff1-2edde56b0771 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.197607 Sep 06 04:40:58.795188 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 309/596] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:58 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:40:59.677668 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-79da7b64-53ca-47ae-ada6-dea8ca1d18ea tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:59.678215 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-79da7b64-53ca-47ae-ada6-dea8ca1d18ea tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:59.684793 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79da7b64-53ca-47ae-ada6-dea8ca1d18ea tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:59.685272 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79da7b64-53ca-47ae-ada6-dea8ca1d18ea tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:59.685736 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79da7b64-53ca-47ae-ada6-dea8ca1d18ea tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:59.687206 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79da7b64-53ca-47ae-ada6-dea8ca1d18ea tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:59.687715 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79da7b64-53ca-47ae-ada6-dea8ca1d18ea tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:59.688137 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79da7b64-53ca-47ae-ada6-dea8ca1d18ea tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:59.818269 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-79da7b64-53ca-47ae-ada6-dea8ca1d18ea tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:59.825946 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-79da7b64-53ca-47ae-ada6-dea8ca1d18ea tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1319 microversion: 2.1 time: 0.152306 Sep 06 04:40:59.826112 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2c1cd5ad-e004-44ed-802f-95b0066a2efc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:40:59.826544 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 288/597] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:40:59 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:40:59.826628 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2c1cd5ad-e004-44ed-802f-95b0066a2efc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:40:59.833645 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c1cd5ad-e004-44ed-802f-95b0066a2efc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:59.834124 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c1cd5ad-e004-44ed-802f-95b0066a2efc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:59.834555 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c1cd5ad-e004-44ed-802f-95b0066a2efc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:59.835240 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c1cd5ad-e004-44ed-802f-95b0066a2efc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:40:59.835690 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c1cd5ad-e004-44ed-802f-95b0066a2efc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:40:59.836107 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c1cd5ad-e004-44ed-802f-95b0066a2efc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:40:59.970192 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2c1cd5ad-e004-44ed-802f-95b0066a2efc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:59.978903 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2c1cd5ad-e004-44ed-802f-95b0066a2efc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:59.980358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2c1cd5ad-e004-44ed-802f-95b0066a2efc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:40:59.981611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2c1cd5ad-e004-44ed-802f-95b0066a2efc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.159344 Sep 06 04:40:59.982201 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 310/598] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:40:59 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:41:00.477267 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-b4df23e4-33e5-4a5f-84a2-f29ad0cc55f5 req-d29af0a1-96fd-4e1d-be27-70206d72ae44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53238a8f-2601-4952-acd2-4dcb02761c12", "name": "network-vif-plugged", "status": "completed", "tag": "19322183-60e8-44ac-b690-7448dfce3250"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:41:00.486937 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b4df23e4-33e5-4a5f-84a2-f29ad0cc55f5 req-d29af0a1-96fd-4e1d-be27-70206d72ae44 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:00.487417 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b4df23e4-33e5-4a5f-84a2-f29ad0cc55f5 req-d29af0a1-96fd-4e1d-be27-70206d72ae44 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:00.487858 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-b4df23e4-33e5-4a5f-84a2-f29ad0cc55f5 req-d29af0a1-96fd-4e1d-be27-70206d72ae44 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:00.498667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-b4df23e4-33e5-4a5f-84a2-f29ad0cc55f5 req-d29af0a1-96fd-4e1d-be27-70206d72ae44 service nova] Creating event network-vif-plugged:19322183-60e8-44ac-b690-7448dfce3250 for instance 53238a8f-2601-4952-acd2-4dcb02761c12 on hv-cinder-85600 Sep 06 04:41:00.503713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-b4df23e4-33e5-4a5f-84a2-f29ad0cc55f5 req-d29af0a1-96fd-4e1d-be27-70206d72ae44 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030028 Sep 06 04:41:00.504489 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 289/599] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:41:00.849367 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9b691182-7833-4f9b-813e-4293ffd1d567 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:00.849883 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9b691182-7833-4f9b-813e-4293ffd1d567 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:00.856257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b691182-7833-4f9b-813e-4293ffd1d567 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:00.856735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b691182-7833-4f9b-813e-4293ffd1d567 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:00.857163 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b691182-7833-4f9b-813e-4293ffd1d567 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:00.857866 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b691182-7833-4f9b-813e-4293ffd1d567 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:00.858979 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b691182-7833-4f9b-813e-4293ffd1d567 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:00.859391 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9b691182-7833-4f9b-813e-4293ffd1d567 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:00.985948 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9b691182-7833-4f9b-813e-4293ffd1d567 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:00.993524 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9b691182-7833-4f9b-813e-4293ffd1d567 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1319 microversion: 2.1 time: 0.148140 Sep 06 04:41:00.994098 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 311/600] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:00 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:01.007607 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8a97104b-82c0-412d-b67a-cbda5ed72086 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:01.008386 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8a97104b-82c0-412d-b67a-cbda5ed72086 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:01.015129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8a97104b-82c0-412d-b67a-cbda5ed72086 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:01.015616 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8a97104b-82c0-412d-b67a-cbda5ed72086 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:01.016053 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8a97104b-82c0-412d-b67a-cbda5ed72086 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:01.016747 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8a97104b-82c0-412d-b67a-cbda5ed72086 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:01.017197 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8a97104b-82c0-412d-b67a-cbda5ed72086 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:01.017647 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8a97104b-82c0-412d-b67a-cbda5ed72086 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:01.151672 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8a97104b-82c0-412d-b67a-cbda5ed72086 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:01.160670 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8a97104b-82c0-412d-b67a-cbda5ed72086 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:01.163271 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8a97104b-82c0-412d-b67a-cbda5ed72086 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:01.163271 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8a97104b-82c0-412d-b67a-cbda5ed72086 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.160374 Sep 06 04:41:01.163908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 290/601] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:41:01 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:41:01.418041 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a601580c-dcaf-49c8-bcca-f723d778e70b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8808f00-b1d4-49cd-8b79-a2c5b41ac191"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:41:01.420425 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a601580c-dcaf-49c8-bcca-f723d778e70b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:01.429194 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a601580c-dcaf-49c8-bcca-f723d778e70b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:01.429713 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a601580c-dcaf-49c8-bcca-f723d778e70b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:01.430146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a601580c-dcaf-49c8-bcca-f723d778e70b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:01.433292 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a601580c-dcaf-49c8-bcca-f723d778e70b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:01.433776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a601580c-dcaf-49c8-bcca-f723d778e70b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:01.434204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a601580c-dcaf-49c8-bcca-f723d778e70b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:02.016438 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8ddee22c-d799-49f7-b8d5-9b819b5360b6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:02.017046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8ddee22c-d799-49f7-b8d5-9b819b5360b6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:02.023877 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ddee22c-d799-49f7-b8d5-9b819b5360b6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:02.024368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ddee22c-d799-49f7-b8d5-9b819b5360b6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:02.024819 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ddee22c-d799-49f7-b8d5-9b819b5360b6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:02.028212 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ddee22c-d799-49f7-b8d5-9b819b5360b6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:02.028212 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ddee22c-d799-49f7-b8d5-9b819b5360b6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:02.028212 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ddee22c-d799-49f7-b8d5-9b819b5360b6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:02.163186 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8ddee22c-d799-49f7-b8d5-9b819b5360b6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:02.171611 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8ddee22c-d799-49f7-b8d5-9b819b5360b6 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1507 microversion: 2.1 time: 0.159558 Sep 06 04:41:02.172161 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 291/602] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:02 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:41:02.187940 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-49bfbe3e-89ae-406d-a70d-3d2b8bacd1c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:02.188545 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-49bfbe3e-89ae-406d-a70d-3d2b8bacd1c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:02.194700 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49bfbe3e-89ae-406d-a70d-3d2b8bacd1c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:02.195182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49bfbe3e-89ae-406d-a70d-3d2b8bacd1c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:02.195619 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49bfbe3e-89ae-406d-a70d-3d2b8bacd1c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:02.196309 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49bfbe3e-89ae-406d-a70d-3d2b8bacd1c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:02.196798 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49bfbe3e-89ae-406d-a70d-3d2b8bacd1c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:02.197220 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49bfbe3e-89ae-406d-a70d-3d2b8bacd1c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:02.327216 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-49bfbe3e-89ae-406d-a70d-3d2b8bacd1c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:02.335942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-49bfbe3e-89ae-406d-a70d-3d2b8bacd1c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:02.337544 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-49bfbe3e-89ae-406d-a70d-3d2b8bacd1c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:02.338726 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-49bfbe3e-89ae-406d-a70d-3d2b8bacd1c6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.154786 Sep 06 04:41:02.339518 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 292/603] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:41:02 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:41:02.345051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-575ce6c9-0bb6-43e9-87b3-b6e91f288ad2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "142ffb04-5d8c-426e-874c-336beefd0194", "device": "/dev/sdb"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:41:02.348001 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-575ce6c9-0bb6-43e9-87b3-b6e91f288ad2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:02.353941 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-575ce6c9-0bb6-43e9-87b3-b6e91f288ad2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:02.354423 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-575ce6c9-0bb6-43e9-87b3-b6e91f288ad2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:02.354983 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-575ce6c9-0bb6-43e9-87b3-b6e91f288ad2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:02.355645 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-575ce6c9-0bb6-43e9-87b3-b6e91f288ad2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:02.356100 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-575ce6c9-0bb6-43e9-87b3-b6e91f288ad2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:02.356550 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-575ce6c9-0bb6-43e9-87b3-b6e91f288ad2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:02.481709 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a601580c-dcaf-49c8-bcca-f723d778e70b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "POST /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.172617 Sep 06 04:41:02.482318 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 312/604] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Sep 6 04:41:01 2022] POST /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-volume_attachments => generated 194 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:41:03.365877 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-aac9a699-f99b-42a5-8dfb-d94b31b59a0c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:03.366563 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-aac9a699-f99b-42a5-8dfb-d94b31b59a0c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:03.372650 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aac9a699-f99b-42a5-8dfb-d94b31b59a0c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:03.373126 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aac9a699-f99b-42a5-8dfb-d94b31b59a0c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:03.373716 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aac9a699-f99b-42a5-8dfb-d94b31b59a0c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:03.375062 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aac9a699-f99b-42a5-8dfb-d94b31b59a0c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:03.375642 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aac9a699-f99b-42a5-8dfb-d94b31b59a0c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:03.375930 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aac9a699-f99b-42a5-8dfb-d94b31b59a0c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:03.507909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-aac9a699-f99b-42a5-8dfb-d94b31b59a0c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:03.510235 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:41:03.517267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-aac9a699-f99b-42a5-8dfb-d94b31b59a0c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:03.518715 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-aac9a699-f99b-42a5-8dfb-d94b31b59a0c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:03.519843 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-aac9a699-f99b-42a5-8dfb-d94b31b59a0c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.158814 Sep 06 04:41:03.520396 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 313/605] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:41:03 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:41:04.173135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-575ce6c9-0bb6-43e9-87b3-b6e91f288ad2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "POST /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.832503 Sep 06 04:41:04.173717 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 293/606] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Sep 6 04:41:02 2022] POST /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe/os-volume_attachments => generated 194 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:41:04.544801 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-85ca67e9-8da4-4d94-88a7-796d9ee4b0db tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:04.546013 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-85ca67e9-8da4-4d94-88a7-796d9ee4b0db tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:04.553050 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85ca67e9-8da4-4d94-88a7-796d9ee4b0db tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:04.553549 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85ca67e9-8da4-4d94-88a7-796d9ee4b0db tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:04.553979 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85ca67e9-8da4-4d94-88a7-796d9ee4b0db tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:04.554662 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85ca67e9-8da4-4d94-88a7-796d9ee4b0db tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:04.555111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85ca67e9-8da4-4d94-88a7-796d9ee4b0db tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:04.555565 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-85ca67e9-8da4-4d94-88a7-796d9ee4b0db tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:04.690845 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-85ca67e9-8da4-4d94-88a7-796d9ee4b0db tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:04.699635 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-85ca67e9-8da4-4d94-88a7-796d9ee4b0db tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:04.701067 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-85ca67e9-8da4-4d94-88a7-796d9ee4b0db tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:04.702804 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-85ca67e9-8da4-4d94-88a7-796d9ee4b0db tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.161713 Sep 06 04:41:04.703381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 314/607] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:41:04 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:41:05.730456 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b362ed6b-15ef-4633-bd9b-05754631309d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:05.731177 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b362ed6b-15ef-4633-bd9b-05754631309d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:05.738108 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b362ed6b-15ef-4633-bd9b-05754631309d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:05.738584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b362ed6b-15ef-4633-bd9b-05754631309d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:05.739017 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b362ed6b-15ef-4633-bd9b-05754631309d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:05.739740 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b362ed6b-15ef-4633-bd9b-05754631309d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:05.740194 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b362ed6b-15ef-4633-bd9b-05754631309d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:05.740614 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b362ed6b-15ef-4633-bd9b-05754631309d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:05.876317 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b362ed6b-15ef-4633-bd9b-05754631309d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:05.884935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b362ed6b-15ef-4633-bd9b-05754631309d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:05.886394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b362ed6b-15ef-4633-bd9b-05754631309d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:05.887543 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b362ed6b-15ef-4633-bd9b-05754631309d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1808 microversion: 2.20 time: 0.161921 Sep 06 04:41:05.888094 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 294/608] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:41:05 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:41:06.913888 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-10c4d4e0-c522-44b6-9d52-760939043430 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:06.914499 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-10c4d4e0-c522-44b6-9d52-760939043430 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:06.921613 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10c4d4e0-c522-44b6-9d52-760939043430 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:06.922100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10c4d4e0-c522-44b6-9d52-760939043430 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:06.922533 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10c4d4e0-c522-44b6-9d52-760939043430 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:06.923221 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10c4d4e0-c522-44b6-9d52-760939043430 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:06.923681 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10c4d4e0-c522-44b6-9d52-760939043430 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:06.924103 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-10c4d4e0-c522-44b6-9d52-760939043430 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:07.048760 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-10c4d4e0-c522-44b6-9d52-760939043430 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:07.057247 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-10c4d4e0-c522-44b6-9d52-760939043430 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:07.058718 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-10c4d4e0-c522-44b6-9d52-760939043430 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:07.059871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-10c4d4e0-c522-44b6-9d52-760939043430 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1795 microversion: 2.20 time: 0.149966 Sep 06 04:41:07.060458 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 315/609] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:41:06 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1795 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:41:12.148020 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cf550b45-0e2e-40b9-b158-bab8aaa3df37 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:41:12.150276 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cf550b45-0e2e-40b9-b158-bab8aaa3df37 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:12.158272 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf550b45-0e2e-40b9-b158-bab8aaa3df37 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:12.158873 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf550b45-0e2e-40b9-b158-bab8aaa3df37 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:12.159317 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf550b45-0e2e-40b9-b158-bab8aaa3df37 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:12.160016 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf550b45-0e2e-40b9-b158-bab8aaa3df37 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:12.160469 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf550b45-0e2e-40b9-b158-bab8aaa3df37 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:12.160894 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cf550b45-0e2e-40b9-b158-bab8aaa3df37 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:12.185485 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-cf550b45-0e2e-40b9-b158-bab8aaa3df37 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lazy-loading 'flavor' on Instance uuid 4631439d-ba1a-4895-88bc-66f83e93defa {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:41:12.322479 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:41:12.484699 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cf550b45-0e2e-40b9-b158-bab8aaa3df37 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "POST /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/action" status: 200 len: 32 microversion: 2.1 time: 0.340851 Sep 06 04:41:12.485223 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 295/610] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Sep 6 04:41:12 2022] POST /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/action => generated 32 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 04:41:12.494750 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-80cd176f-7bcf-4531-81d1-03ffa21645ed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:12.495414 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-80cd176f-7bcf-4531-81d1-03ffa21645ed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:12.498126 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=48 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:41:12.505042 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-80cd176f-7bcf-4531-81d1-03ffa21645ed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:12.505563 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-80cd176f-7bcf-4531-81d1-03ffa21645ed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:12.506114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-80cd176f-7bcf-4531-81d1-03ffa21645ed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:12.506722 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-80cd176f-7bcf-4531-81d1-03ffa21645ed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:12.507179 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-80cd176f-7bcf-4531-81d1-03ffa21645ed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:12.507601 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-80cd176f-7bcf-4531-81d1-03ffa21645ed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:12.643095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-80cd176f-7bcf-4531-81d1-03ffa21645ed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:12.651846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-80cd176f-7bcf-4531-81d1-03ffa21645ed tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.160886 Sep 06 04:41:12.652974 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 316/611] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:12 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:13.678471 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a965751a-6768-4ff5-8cca-3b00e18d1c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:13.679368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a965751a-6768-4ff5-8cca-3b00e18d1c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:13.686570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a965751a-6768-4ff5-8cca-3b00e18d1c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:13.687057 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a965751a-6768-4ff5-8cca-3b00e18d1c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:13.687493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a965751a-6768-4ff5-8cca-3b00e18d1c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:13.688184 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a965751a-6768-4ff5-8cca-3b00e18d1c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:13.688638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a965751a-6768-4ff5-8cca-3b00e18d1c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:13.689091 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a965751a-6768-4ff5-8cca-3b00e18d1c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:13.816476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a965751a-6768-4ff5-8cca-3b00e18d1c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:13.824757 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a965751a-6768-4ff5-8cca-3b00e18d1c1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.151497 Sep 06 04:41:13.825348 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 296/612] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:13 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:14.848765 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-81b95625-688d-43a9-8a01-ffea21570139 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:14.849387 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-81b95625-688d-43a9-8a01-ffea21570139 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:14.855860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81b95625-688d-43a9-8a01-ffea21570139 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:14.856334 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81b95625-688d-43a9-8a01-ffea21570139 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:14.856760 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81b95625-688d-43a9-8a01-ffea21570139 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:14.857465 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81b95625-688d-43a9-8a01-ffea21570139 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:14.858430 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81b95625-688d-43a9-8a01-ffea21570139 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:14.858846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-81b95625-688d-43a9-8a01-ffea21570139 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:14.985593 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-81b95625-688d-43a9-8a01-ffea21570139 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:14.993656 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-81b95625-688d-43a9-8a01-ffea21570139 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.149012 Sep 06 04:41:14.994214 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 317/613] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:14 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:16.017754 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bb19d5dd-dbec-4650-b01b-628b9bb5c2d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:16.018359 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bb19d5dd-dbec-4650-b01b-628b9bb5c2d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:16.020754 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=48 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:41:16.025418 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb19d5dd-dbec-4650-b01b-628b9bb5c2d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:16.025892 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb19d5dd-dbec-4650-b01b-628b9bb5c2d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:16.026322 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb19d5dd-dbec-4650-b01b-628b9bb5c2d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:16.027260 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb19d5dd-dbec-4650-b01b-628b9bb5c2d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:16.027710 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb19d5dd-dbec-4650-b01b-628b9bb5c2d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:16.028124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb19d5dd-dbec-4650-b01b-628b9bb5c2d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:16.158691 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bb19d5dd-dbec-4650-b01b-628b9bb5c2d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:16.166716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bb19d5dd-dbec-4650-b01b-628b9bb5c2d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.153857 Sep 06 04:41:16.167276 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 297/614] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:16 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:17.189935 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a2165d23-bdec-48a3-9daf-f1617089bfc1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:17.190463 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a2165d23-bdec-48a3-9daf-f1617089bfc1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:17.196905 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2165d23-bdec-48a3-9daf-f1617089bfc1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:17.197451 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2165d23-bdec-48a3-9daf-f1617089bfc1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:17.198052 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2165d23-bdec-48a3-9daf-f1617089bfc1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:17.198730 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2165d23-bdec-48a3-9daf-f1617089bfc1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:17.199175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2165d23-bdec-48a3-9daf-f1617089bfc1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:17.199589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a2165d23-bdec-48a3-9daf-f1617089bfc1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:17.334081 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a2165d23-bdec-48a3-9daf-f1617089bfc1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:17.343145 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a2165d23-bdec-48a3-9daf-f1617089bfc1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.156601 Sep 06 04:41:17.343833 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 318/615] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:17 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:18.367197 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-971c3b92-7fc9-4903-876c-7c2713a02ec3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:18.367801 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-971c3b92-7fc9-4903-876c-7c2713a02ec3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:18.374885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-971c3b92-7fc9-4903-876c-7c2713a02ec3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:18.375423 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-971c3b92-7fc9-4903-876c-7c2713a02ec3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:18.375873 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-971c3b92-7fc9-4903-876c-7c2713a02ec3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:18.376555 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-971c3b92-7fc9-4903-876c-7c2713a02ec3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:18.377035 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-971c3b92-7fc9-4903-876c-7c2713a02ec3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:18.377484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-971c3b92-7fc9-4903-876c-7c2713a02ec3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:18.506454 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-971c3b92-7fc9-4903-876c-7c2713a02ec3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:18.516219 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-971c3b92-7fc9-4903-876c-7c2713a02ec3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.151335 Sep 06 04:41:18.516892 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 298/616] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:18 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:19.539989 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-69e5de91-a139-48bc-8435-765edffdb4e4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:19.540596 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-69e5de91-a139-48bc-8435-765edffdb4e4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:19.547686 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69e5de91-a139-48bc-8435-765edffdb4e4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:19.548170 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69e5de91-a139-48bc-8435-765edffdb4e4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:19.548604 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69e5de91-a139-48bc-8435-765edffdb4e4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:19.549285 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69e5de91-a139-48bc-8435-765edffdb4e4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:19.549759 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69e5de91-a139-48bc-8435-765edffdb4e4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:19.550178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69e5de91-a139-48bc-8435-765edffdb4e4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:19.677667 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-69e5de91-a139-48bc-8435-765edffdb4e4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:19.686459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-69e5de91-a139-48bc-8435-765edffdb4e4 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.149772 Sep 06 04:41:19.687033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 319/617] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:19 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:20.711672 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b2362b68-0acd-4cf0-978d-299c3197de94 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:20.713019 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b2362b68-0acd-4cf0-978d-299c3197de94 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:20.720768 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2362b68-0acd-4cf0-978d-299c3197de94 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:20.721358 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2362b68-0acd-4cf0-978d-299c3197de94 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:20.721778 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2362b68-0acd-4cf0-978d-299c3197de94 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:20.722791 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2362b68-0acd-4cf0-978d-299c3197de94 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:20.723500 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2362b68-0acd-4cf0-978d-299c3197de94 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:20.724036 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b2362b68-0acd-4cf0-978d-299c3197de94 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:20.853181 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b2362b68-0acd-4cf0-978d-299c3197de94 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:20.861794 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b2362b68-0acd-4cf0-978d-299c3197de94 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.155210 Sep 06 04:41:20.862354 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 299/618] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:20 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:21.886033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e42e898c-91c4-40a9-a8a0-77830afbe5ac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:21.886633 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e42e898c-91c4-40a9-a8a0-77830afbe5ac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:21.893614 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e42e898c-91c4-40a9-a8a0-77830afbe5ac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:21.894089 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e42e898c-91c4-40a9-a8a0-77830afbe5ac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:21.894516 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e42e898c-91c4-40a9-a8a0-77830afbe5ac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:21.895188 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e42e898c-91c4-40a9-a8a0-77830afbe5ac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:21.895640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e42e898c-91c4-40a9-a8a0-77830afbe5ac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:21.896048 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e42e898c-91c4-40a9-a8a0-77830afbe5ac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:22.024751 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e42e898c-91c4-40a9-a8a0-77830afbe5ac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:22.033661 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e42e898c-91c4-40a9-a8a0-77830afbe5ac tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.151441 Sep 06 04:41:22.034223 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 320/619] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:21 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:23.057583 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-44c28333-2938-42ab-9410-845b48f7ca79 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:23.058184 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-44c28333-2938-42ab-9410-845b48f7ca79 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:23.065265 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44c28333-2938-42ab-9410-845b48f7ca79 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:23.065795 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44c28333-2938-42ab-9410-845b48f7ca79 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:23.066223 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44c28333-2938-42ab-9410-845b48f7ca79 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:23.066896 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44c28333-2938-42ab-9410-845b48f7ca79 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:23.067342 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44c28333-2938-42ab-9410-845b48f7ca79 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:23.067753 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44c28333-2938-42ab-9410-845b48f7ca79 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:23.447049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-44c28333-2938-42ab-9410-845b48f7ca79 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:23.455940 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-44c28333-2938-42ab-9410-845b48f7ca79 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.402261 Sep 06 04:41:23.456540 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 300/620] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:23 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:24.479011 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6c98e951-564e-4e35-97c7-39c09989d803 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:24.479608 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6c98e951-564e-4e35-97c7-39c09989d803 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:24.482351 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 04:41:24.482502 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Tue Sep 6 04:41:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa (ip 10.222.0.30) !!! Sep 06 04:41:24.488478 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c98e951-564e-4e35-97c7-39c09989d803 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:24.488956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c98e951-564e-4e35-97c7-39c09989d803 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:24.489409 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c98e951-564e-4e35-97c7-39c09989d803 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:24.490087 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c98e951-564e-4e35-97c7-39c09989d803 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:24.490531 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c98e951-564e-4e35-97c7-39c09989d803 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:24.490948 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c98e951-564e-4e35-97c7-39c09989d803 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:24.621184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6c98e951-564e-4e35-97c7-39c09989d803 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:24.630250 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6c98e951-564e-4e35-97c7-39c09989d803 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.155027 Sep 06 04:41:24.630818 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 321/621] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:24 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:25.660004 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a90a8a67-503d-4d5d-ace7-beebdaa820e1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:25.660513 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a90a8a67-503d-4d5d-ace7-beebdaa820e1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:25.666859 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a90a8a67-503d-4d5d-ace7-beebdaa820e1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:25.667335 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a90a8a67-503d-4d5d-ace7-beebdaa820e1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:25.667762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a90a8a67-503d-4d5d-ace7-beebdaa820e1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:25.668440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a90a8a67-503d-4d5d-ace7-beebdaa820e1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:25.668887 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a90a8a67-503d-4d5d-ace7-beebdaa820e1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:25.669329 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a90a8a67-503d-4d5d-ace7-beebdaa820e1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:25.804418 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a90a8a67-503d-4d5d-ace7-beebdaa820e1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:25.813421 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a90a8a67-503d-4d5d-ace7-beebdaa820e1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.157308 Sep 06 04:41:25.813983 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 301/622] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:25 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:26.836691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-be083ecc-71d3-4163-b7cf-cb461e63b7ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:26.837318 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-be083ecc-71d3-4163-b7cf-cb461e63b7ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:26.844579 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be083ecc-71d3-4163-b7cf-cb461e63b7ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:26.850146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be083ecc-71d3-4163-b7cf-cb461e63b7ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:26.850146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be083ecc-71d3-4163-b7cf-cb461e63b7ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:26.850146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be083ecc-71d3-4163-b7cf-cb461e63b7ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:26.850146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be083ecc-71d3-4163-b7cf-cb461e63b7ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:26.850530 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be083ecc-71d3-4163-b7cf-cb461e63b7ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:26.978859 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-be083ecc-71d3-4163-b7cf-cb461e63b7ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:26.986518 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-be083ecc-71d3-4163-b7cf-cb461e63b7ae tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.153604 Sep 06 04:41:26.987314 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 322/623] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:26 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:28.010690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e6ad473a-c8e2-4316-80c0-bd042180dd2f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:28.011329 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e6ad473a-c8e2-4316-80c0-bd042180dd2f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:28.018728 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6ad473a-c8e2-4316-80c0-bd042180dd2f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:28.019214 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6ad473a-c8e2-4316-80c0-bd042180dd2f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:28.019641 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6ad473a-c8e2-4316-80c0-bd042180dd2f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:28.020328 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6ad473a-c8e2-4316-80c0-bd042180dd2f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:28.020773 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6ad473a-c8e2-4316-80c0-bd042180dd2f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:28.021189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6ad473a-c8e2-4316-80c0-bd042180dd2f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:28.155835 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e6ad473a-c8e2-4316-80c0-bd042180dd2f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:28.164696 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e6ad473a-c8e2-4316-80c0-bd042180dd2f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.157746 Sep 06 04:41:28.165264 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 302/624] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:28 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:29.188036 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c56229df-3f13-47cb-9a23-e39773624f1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:29.188685 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c56229df-3f13-47cb-9a23-e39773624f1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:29.194930 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c56229df-3f13-47cb-9a23-e39773624f1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:29.195398 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c56229df-3f13-47cb-9a23-e39773624f1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:29.195826 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c56229df-3f13-47cb-9a23-e39773624f1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:29.196517 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c56229df-3f13-47cb-9a23-e39773624f1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:29.196941 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c56229df-3f13-47cb-9a23-e39773624f1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:29.197380 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c56229df-3f13-47cb-9a23-e39773624f1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:29.328637 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c56229df-3f13-47cb-9a23-e39773624f1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:29.336826 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c56229df-3f13-47cb-9a23-e39773624f1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.152753 Sep 06 04:41:29.337407 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 323/625] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:29 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:30.360332 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-414be5a0-37ee-4b4b-9453-c212d84cb7fd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:30.360936 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-414be5a0-37ee-4b4b-9453-c212d84cb7fd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:30.367620 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-414be5a0-37ee-4b4b-9453-c212d84cb7fd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:30.368102 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-414be5a0-37ee-4b4b-9453-c212d84cb7fd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:30.368533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-414be5a0-37ee-4b4b-9453-c212d84cb7fd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:30.369240 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-414be5a0-37ee-4b4b-9453-c212d84cb7fd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:30.369702 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-414be5a0-37ee-4b4b-9453-c212d84cb7fd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:30.370122 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-414be5a0-37ee-4b4b-9453-c212d84cb7fd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:30.509433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-414be5a0-37ee-4b4b-9453-c212d84cb7fd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:30.518297 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-414be5a0-37ee-4b4b-9453-c212d84cb7fd tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.162255 Sep 06 04:41:30.518873 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 303/626] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:30 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:31.543212 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3e85c8b4-ce95-43f9-95fb-1dd60baf7102 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:31.543856 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3e85c8b4-ce95-43f9-95fb-1dd60baf7102 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:31.551120 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e85c8b4-ce95-43f9-95fb-1dd60baf7102 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:31.551604 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e85c8b4-ce95-43f9-95fb-1dd60baf7102 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:31.552043 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e85c8b4-ce95-43f9-95fb-1dd60baf7102 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:31.552761 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e85c8b4-ce95-43f9-95fb-1dd60baf7102 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:31.553219 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e85c8b4-ce95-43f9-95fb-1dd60baf7102 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:31.553666 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e85c8b4-ce95-43f9-95fb-1dd60baf7102 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:31.680239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3e85c8b4-ce95-43f9-95fb-1dd60baf7102 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:31.688480 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3e85c8b4-ce95-43f9-95fb-1dd60baf7102 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.149116 Sep 06 04:41:31.689084 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 324/627] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:31 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:32.711935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-413df752-fd42-4dbd-bfa5-0abad8c89ea0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:32.712565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-413df752-fd42-4dbd-bfa5-0abad8c89ea0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:32.719922 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-413df752-fd42-4dbd-bfa5-0abad8c89ea0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:32.720423 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-413df752-fd42-4dbd-bfa5-0abad8c89ea0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:32.720853 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-413df752-fd42-4dbd-bfa5-0abad8c89ea0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:32.721616 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-413df752-fd42-4dbd-bfa5-0abad8c89ea0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:32.722068 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-413df752-fd42-4dbd-bfa5-0abad8c89ea0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:32.722530 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-413df752-fd42-4dbd-bfa5-0abad8c89ea0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:32.852941 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-413df752-fd42-4dbd-bfa5-0abad8c89ea0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:32.861226 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-413df752-fd42-4dbd-bfa5-0abad8c89ea0 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.153173 Sep 06 04:41:32.861817 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 304/628] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:32 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:33.884988 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-653879fb-f04b-4d72-9f45-bbf8961aa90d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:33.885624 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-653879fb-f04b-4d72-9f45-bbf8961aa90d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:33.892039 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-653879fb-f04b-4d72-9f45-bbf8961aa90d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:33.892525 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-653879fb-f04b-4d72-9f45-bbf8961aa90d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:33.892960 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-653879fb-f04b-4d72-9f45-bbf8961aa90d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:33.893706 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-653879fb-f04b-4d72-9f45-bbf8961aa90d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:33.894165 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-653879fb-f04b-4d72-9f45-bbf8961aa90d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:33.894589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-653879fb-f04b-4d72-9f45-bbf8961aa90d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:34.028386 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-653879fb-f04b-4d72-9f45-bbf8961aa90d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:34.037388 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-653879fb-f04b-4d72-9f45-bbf8961aa90d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.156224 Sep 06 04:41:34.037965 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 325/629] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:33 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:35.060835 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c45008d5-a3b6-4c2e-a4ab-8d71d724c6db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:35.061473 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c45008d5-a3b6-4c2e-a4ab-8d71d724c6db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:35.068537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c45008d5-a3b6-4c2e-a4ab-8d71d724c6db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:35.069029 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c45008d5-a3b6-4c2e-a4ab-8d71d724c6db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:35.069507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c45008d5-a3b6-4c2e-a4ab-8d71d724c6db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:35.070197 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c45008d5-a3b6-4c2e-a4ab-8d71d724c6db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:35.070658 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c45008d5-a3b6-4c2e-a4ab-8d71d724c6db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:35.071081 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c45008d5-a3b6-4c2e-a4ab-8d71d724c6db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:35.197621 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c45008d5-a3b6-4c2e-a4ab-8d71d724c6db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:35.205917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c45008d5-a3b6-4c2e-a4ab-8d71d724c6db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.149075 Sep 06 04:41:35.206489 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 305/630] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:35 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:36.229819 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4af4561d-778e-469c-b368-6cb8eba60c01 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:36.230432 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4af4561d-778e-469c-b368-6cb8eba60c01 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:36.237450 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4af4561d-778e-469c-b368-6cb8eba60c01 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:36.237932 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4af4561d-778e-469c-b368-6cb8eba60c01 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:36.238360 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4af4561d-778e-469c-b368-6cb8eba60c01 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:36.239040 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4af4561d-778e-469c-b368-6cb8eba60c01 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:36.239487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4af4561d-778e-469c-b368-6cb8eba60c01 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:36.239906 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4af4561d-778e-469c-b368-6cb8eba60c01 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:36.243773 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=74 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:41:36.375690 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4af4561d-778e-469c-b368-6cb8eba60c01 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:36.384026 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4af4561d-778e-469c-b368-6cb8eba60c01 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.158009 Sep 06 04:41:36.384795 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 326/631] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:36 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:36.682399 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-76a9f1b0-13f7-478d-a949-3b7e132c1f74 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:36.682895 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-76a9f1b0-13f7-478d-a949-3b7e132c1f74 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:36.690071 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76a9f1b0-13f7-478d-a949-3b7e132c1f74 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:36.690549 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76a9f1b0-13f7-478d-a949-3b7e132c1f74 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:36.690976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76a9f1b0-13f7-478d-a949-3b7e132c1f74 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:36.691659 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76a9f1b0-13f7-478d-a949-3b7e132c1f74 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:36.692164 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76a9f1b0-13f7-478d-a949-3b7e132c1f74 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:36.692579 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76a9f1b0-13f7-478d-a949-3b7e132c1f74 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:36.814972 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-76a9f1b0-13f7-478d-a949-3b7e132c1f74 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lazy-loading 'services' on Instance uuid 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:41:37.090580 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-76a9f1b0-13f7-478d-a949-3b7e132c1f74 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe/os-volume_attachments/142ffb04-5d8c-426e-874c-336beefd0194" status: 202 len: 0 microversion: 2.1 time: 0.411962 Sep 06 04:41:37.091165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 306/632] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Sep 6 04:41:36 2022] DELETE /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe/os-volume_attachments/142ffb04-5d8c-426e-874c-336beefd0194 => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:41:37.408335 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7ea48b86-6911-451c-a76e-de0bb31d4fd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:37.408934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7ea48b86-6911-451c-a76e-de0bb31d4fd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:37.414873 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ea48b86-6911-451c-a76e-de0bb31d4fd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:37.415349 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ea48b86-6911-451c-a76e-de0bb31d4fd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:37.415772 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ea48b86-6911-451c-a76e-de0bb31d4fd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:37.416447 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ea48b86-6911-451c-a76e-de0bb31d4fd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:37.416894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ea48b86-6911-451c-a76e-de0bb31d4fd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:37.417338 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7ea48b86-6911-451c-a76e-de0bb31d4fd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:37.546611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7ea48b86-6911-451c-a76e-de0bb31d4fd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:37.554888 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7ea48b86-6911-451c-a76e-de0bb31d4fd7 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.150574 Sep 06 04:41:37.555459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 327/633] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:37 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:38.580728 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7c89ca62-6295-4c0d-b46f-fc8a17a60ea3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:38.581458 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7c89ca62-6295-4c0d-b46f-fc8a17a60ea3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:38.588097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c89ca62-6295-4c0d-b46f-fc8a17a60ea3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:38.588575 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c89ca62-6295-4c0d-b46f-fc8a17a60ea3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:38.589002 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c89ca62-6295-4c0d-b46f-fc8a17a60ea3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:38.589714 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c89ca62-6295-4c0d-b46f-fc8a17a60ea3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:38.590159 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c89ca62-6295-4c0d-b46f-fc8a17a60ea3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:38.590573 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7c89ca62-6295-4c0d-b46f-fc8a17a60ea3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:38.724226 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7c89ca62-6295-4c0d-b46f-fc8a17a60ea3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:38.732347 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7c89ca62-6295-4c0d-b46f-fc8a17a60ea3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1734 microversion: 2.1 time: 0.157399 Sep 06 04:41:38.732913 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 307/634] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:38 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:39.759093 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-792bb353-5106-4522-bad3-580e2d57e9a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:39.759093 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-792bb353-5106-4522-bad3-580e2d57e9a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:39.764792 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-792bb353-5106-4522-bad3-580e2d57e9a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:39.765401 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-792bb353-5106-4522-bad3-580e2d57e9a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:39.765838 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-792bb353-5106-4522-bad3-580e2d57e9a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:39.766527 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-792bb353-5106-4522-bad3-580e2d57e9a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:39.766993 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-792bb353-5106-4522-bad3-580e2d57e9a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:39.767407 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-792bb353-5106-4522-bad3-580e2d57e9a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:39.901052 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-792bb353-5106-4522-bad3-580e2d57e9a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:39.910033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-792bb353-5106-4522-bad3-580e2d57e9a6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1714 microversion: 2.1 time: 0.157578 Sep 06 04:41:39.910591 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 328/635] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:39 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1714 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:39.974653 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-597ca766-6640-43fb-856d-96ee8047d653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:39.975201 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-597ca766-6640-43fb-856d-96ee8047d653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:39.981666 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-597ca766-6640-43fb-856d-96ee8047d653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:39.982148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-597ca766-6640-43fb-856d-96ee8047d653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:39.982584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-597ca766-6640-43fb-856d-96ee8047d653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:39.983286 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-597ca766-6640-43fb-856d-96ee8047d653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:39.983950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-597ca766-6640-43fb-856d-96ee8047d653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:39.984520 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-597ca766-6640-43fb-856d-96ee8047d653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:40.064452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-597ca766-6640-43fb-856d-96ee8047d653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] HTTP exception thrown: Cannot 'detach_volume' instance 4631439d-ba1a-4895-88bc-66f83e93defa while it is in vm_state rescued Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-597ca766-6640-43fb-856d-96ee8047d653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Request method failure captured: Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-volume_attachments/e8808f00-b1d4-49cd-8b79-a2c5b41ac191 HTTP/1.1 Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4ShSrtmqUjFGUKG962wNt7LkzYM3H0fxdZ4mdnzTKicnH2a1pwDbv7dv5CWGNDm2D2-tqaRREzJYjQqF33RYhMiNEgLbULGTL6P0__4bHirkaw0M3xA0fCopVUzt_zEi1at48QcuQnfkdAMrCCuCfH2J4_6gox-co2Z-Cq2ue1hT0 Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 7aa4ca550edd4876a4c6c56deedf9d70 Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1362344250 Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:41:40.066262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:41:40.067656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:41:40.067656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1362344250 Sep 06 04:41:40.067656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 7aa4ca550edd4876a4c6c56deedf9d70 Sep 06 04:41:40.067656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1362344250 Sep 06 04:41:40.067656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-ServerRescueNegativeTestJSON-1362344250-project Sep 06 04:41:40.067656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:41:40.067656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:41:40.067656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: dec1c17550b849dbadbc16e98530b455 Sep 06 04:41:40.067656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1362344250-project Sep 06 04:41:40.067656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:41:40.067656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Cannot 'detach_volume' instance 4631439d-ba1a-4895-88bc-66f83e93defa while it is in vm_state rescued Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'server_id': '4631439d-ba1a-4895-88bc-66f83e93defa', 'id': 'e8808f00-b1d4-49cd-8b79-a2c5b41ac191'} Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4631439d-ba1a-4895-88bc-66f83e93defa in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:41:40.068444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 4631439d-ba1a-4895-88bc-66f83e93defa while it is in vm_state rescued Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 4631439d-ba1a-4895-88bc-66f83e93defa while it is in vm_state rescued Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:41:40.070040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-597ca766-6640-43fb-856d-96ee8047d653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Returning 409 to user: Cannot 'detach_volume' instance 4631439d-ba1a-4895-88bc-66f83e93defa while it is in vm_state rescued {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:41:40.071228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-597ca766-6640-43fb-856d-96ee8047d653 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-volume_attachments/e8808f00-b1d4-49cd-8b79-a2c5b41ac191" status: 409 len: 152 microversion: 2.1 time: 0.097088 Sep 06 04:41:40.071228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 308/636] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Sep 6 04:41:39 2022] DELETE /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-volume_attachments/e8808f00-b1d4-49cd-8b79-a2c5b41ac191 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 06 04:41:40.078008 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9e039bab-4be2-403d-9a8d-2b77f9e9b06b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:41:40.078533 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9e039bab-4be2-403d-9a8d-2b77f9e9b06b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:40.084389 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e039bab-4be2-403d-9a8d-2b77f9e9b06b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:40.085336 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e039bab-4be2-403d-9a8d-2b77f9e9b06b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:40.085336 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e039bab-4be2-403d-9a8d-2b77f9e9b06b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:40.086023 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e039bab-4be2-403d-9a8d-2b77f9e9b06b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:40.086470 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e039bab-4be2-403d-9a8d-2b77f9e9b06b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:40.086881 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e039bab-4be2-403d-9a8d-2b77f9e9b06b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:40.303254 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9e039bab-4be2-403d-9a8d-2b77f9e9b06b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "POST /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/action" status: 202 len: 0 microversion: 2.1 time: 0.229605 Sep 06 04:41:40.306866 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 329/637] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Sep 6 04:41:40 2022] POST /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:41:40.315687 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-38e4bacc-9f62-4ebe-ae92-a3bca3e5dd3c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:40.316727 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-38e4bacc-9f62-4ebe-ae92-a3bca3e5dd3c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:40.323112 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-38e4bacc-9f62-4ebe-ae92-a3bca3e5dd3c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:40.323503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-38e4bacc-9f62-4ebe-ae92-a3bca3e5dd3c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:40.323933 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-38e4bacc-9f62-4ebe-ae92-a3bca3e5dd3c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:40.328077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-38e4bacc-9f62-4ebe-ae92-a3bca3e5dd3c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:40.329001 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-38e4bacc-9f62-4ebe-ae92-a3bca3e5dd3c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:40.330073 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-38e4bacc-9f62-4ebe-ae92-a3bca3e5dd3c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:40.333237 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-596db21e-f043-48c2-bd62-1632fcf2137f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:40.333846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-596db21e-f043-48c2-bd62-1632fcf2137f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:40.339933 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-596db21e-f043-48c2-bd62-1632fcf2137f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:40.340483 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-596db21e-f043-48c2-bd62-1632fcf2137f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:40.340913 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-596db21e-f043-48c2-bd62-1632fcf2137f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:40.341636 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-596db21e-f043-48c2-bd62-1632fcf2137f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:40.342089 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-596db21e-f043-48c2-bd62-1632fcf2137f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:40.342507 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-596db21e-f043-48c2-bd62-1632fcf2137f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:40.373856 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-596db21e-f043-48c2-bd62-1632fcf2137f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:41:40.494598 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-38e4bacc-9f62-4ebe-ae92-a3bca3e5dd3c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:40.504182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-38e4bacc-9f62-4ebe-ae92-a3bca3e5dd3c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1722 microversion: 2.1 time: 0.193990 Sep 06 04:41:40.504760 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 309/638] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:40 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:40.706252 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-596db21e-f043-48c2-bd62-1632fcf2137f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "DELETE /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 204 len: 0 microversion: 2.1 time: 0.377217 Sep 06 04:41:40.706976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 330/639] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:41:40 2022] DELETE /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 04:41:40.715496 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ca2ed8c9-6480-4b51-ae2d-de11a04320b1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:40.716110 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ca2ed8c9-6480-4b51-ae2d-de11a04320b1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:40.723087 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca2ed8c9-6480-4b51-ae2d-de11a04320b1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:40.723625 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca2ed8c9-6480-4b51-ae2d-de11a04320b1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:40.728136 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca2ed8c9-6480-4b51-ae2d-de11a04320b1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:40.728136 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca2ed8c9-6480-4b51-ae2d-de11a04320b1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:40.728136 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca2ed8c9-6480-4b51-ae2d-de11a04320b1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:40.728136 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ca2ed8c9-6480-4b51-ae2d-de11a04320b1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:40.854025 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ca2ed8c9-6480-4b51-ae2d-de11a04320b1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:40.862218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ca2ed8c9-6480-4b51-ae2d-de11a04320b1 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1513 microversion: 2.1 time: 0.150744 Sep 06 04:41:40.862780 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 310/640] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:40 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:41:41.528792 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ca1ffdcc-4573-4847-8df3-aaedc2dae315 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:41.529530 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ca1ffdcc-4573-4847-8df3-aaedc2dae315 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:41.536563 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ca1ffdcc-4573-4847-8df3-aaedc2dae315 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:41.537049 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ca1ffdcc-4573-4847-8df3-aaedc2dae315 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:41.537516 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ca1ffdcc-4573-4847-8df3-aaedc2dae315 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:41.538200 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ca1ffdcc-4573-4847-8df3-aaedc2dae315 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:41.538657 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ca1ffdcc-4573-4847-8df3-aaedc2dae315 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:41.539079 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ca1ffdcc-4573-4847-8df3-aaedc2dae315 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:41.671506 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ca1ffdcc-4573-4847-8df3-aaedc2dae315 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:41.679788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ca1ffdcc-4573-4847-8df3-aaedc2dae315 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1722 microversion: 2.1 time: 0.155488 Sep 06 04:41:41.680341 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 331/641] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:41 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:41.886044 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2973c1a6-1c79-46a5-83a7-0ce57a0b375f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:41.886679 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2973c1a6-1c79-46a5-83a7-0ce57a0b375f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:41.893073 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2973c1a6-1c79-46a5-83a7-0ce57a0b375f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:41.893602 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2973c1a6-1c79-46a5-83a7-0ce57a0b375f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:41.894046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2973c1a6-1c79-46a5-83a7-0ce57a0b375f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:41.894705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2973c1a6-1c79-46a5-83a7-0ce57a0b375f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:41.895150 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2973c1a6-1c79-46a5-83a7-0ce57a0b375f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:41.895563 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2973c1a6-1c79-46a5-83a7-0ce57a0b375f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:41.910792 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:41:42.020776 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2973c1a6-1c79-46a5-83a7-0ce57a0b375f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:42.028635 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2973c1a6-1c79-46a5-83a7-0ce57a0b375f tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1513 microversion: 2.1 time: 0.146389 Sep 06 04:41:42.029184 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 311/642] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:41 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:42.703410 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ba3aa420-b0d1-4437-94ae-46c44c9ff33a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:42.704010 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ba3aa420-b0d1-4437-94ae-46c44c9ff33a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:42.706418 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:41:42.711148 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ba3aa420-b0d1-4437-94ae-46c44c9ff33a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:42.713381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ba3aa420-b0d1-4437-94ae-46c44c9ff33a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:42.713381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ba3aa420-b0d1-4437-94ae-46c44c9ff33a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:42.713381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ba3aa420-b0d1-4437-94ae-46c44c9ff33a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:42.713381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ba3aa420-b0d1-4437-94ae-46c44c9ff33a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:42.713816 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ba3aa420-b0d1-4437-94ae-46c44c9ff33a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:42.839439 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ba3aa420-b0d1-4437-94ae-46c44c9ff33a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:42.848387 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ba3aa420-b0d1-4437-94ae-46c44c9ff33a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1722 microversion: 2.1 time: 0.148971 Sep 06 04:41:42.848954 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 332/643] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:42 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:43.051097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-72950797-6705-4422-93ac-24d9534ec62e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:43.051702 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-72950797-6705-4422-93ac-24d9534ec62e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:43.058021 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-72950797-6705-4422-93ac-24d9534ec62e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:43.058492 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-72950797-6705-4422-93ac-24d9534ec62e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:43.058917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-72950797-6705-4422-93ac-24d9534ec62e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:43.059587 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-72950797-6705-4422-93ac-24d9534ec62e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:43.060063 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-72950797-6705-4422-93ac-24d9534ec62e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:43.060474 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-72950797-6705-4422-93ac-24d9534ec62e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:43.186220 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-72950797-6705-4422-93ac-24d9534ec62e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:43.193855 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-72950797-6705-4422-93ac-24d9534ec62e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1513 microversion: 2.1 time: 0.146550 Sep 06 04:41:43.194430 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 312/644] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:43 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:43.872472 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-82ee5364-c865-4b18-a49d-1f4e00b96c12 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:43.873101 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-82ee5364-c865-4b18-a49d-1f4e00b96c12 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:43.880529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82ee5364-c865-4b18-a49d-1f4e00b96c12 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:43.881010 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82ee5364-c865-4b18-a49d-1f4e00b96c12 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:43.881483 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82ee5364-c865-4b18-a49d-1f4e00b96c12 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:43.882166 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82ee5364-c865-4b18-a49d-1f4e00b96c12 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:43.882625 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82ee5364-c865-4b18-a49d-1f4e00b96c12 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:43.883065 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82ee5364-c865-4b18-a49d-1f4e00b96c12 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:44.010790 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-82ee5364-c865-4b18-a49d-1f4e00b96c12 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:44.019182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-82ee5364-c865-4b18-a49d-1f4e00b96c12 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1722 microversion: 2.1 time: 0.150912 Sep 06 04:41:44.019777 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 333/645] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:43 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:44.217226 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8c652125-15eb-4784-9b16-ac644bcf95a2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:44.218880 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8c652125-15eb-4784-9b16-ac644bcf95a2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:44.225200 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c652125-15eb-4784-9b16-ac644bcf95a2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:44.225712 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c652125-15eb-4784-9b16-ac644bcf95a2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:44.226146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c652125-15eb-4784-9b16-ac644bcf95a2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:44.226827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c652125-15eb-4784-9b16-ac644bcf95a2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:44.227278 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c652125-15eb-4784-9b16-ac644bcf95a2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:44.227697 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8c652125-15eb-4784-9b16-ac644bcf95a2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:44.357354 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8c652125-15eb-4784-9b16-ac644bcf95a2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:44.366007 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8c652125-15eb-4784-9b16-ac644bcf95a2 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1513 microversion: 2.1 time: 0.152643 Sep 06 04:41:44.366610 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 313/646] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:44 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:45.042086 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-671bd948-fddd-43dc-b48e-97bf8a3df91b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:45.042692 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-671bd948-fddd-43dc-b48e-97bf8a3df91b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:45.049255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-671bd948-fddd-43dc-b48e-97bf8a3df91b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:45.049758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-671bd948-fddd-43dc-b48e-97bf8a3df91b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:45.050188 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-671bd948-fddd-43dc-b48e-97bf8a3df91b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:45.050861 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-671bd948-fddd-43dc-b48e-97bf8a3df91b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:45.051314 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-671bd948-fddd-43dc-b48e-97bf8a3df91b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:45.051730 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-671bd948-fddd-43dc-b48e-97bf8a3df91b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:45.189170 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-671bd948-fddd-43dc-b48e-97bf8a3df91b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:45.197574 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-671bd948-fddd-43dc-b48e-97bf8a3df91b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1722 microversion: 2.1 time: 0.159313 Sep 06 04:41:45.198141 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 334/647] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:45 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:45.390686 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c02fdea1-e523-417c-b9fe-aea38c48234e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:45.391374 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c02fdea1-e523-417c-b9fe-aea38c48234e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:45.397892 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c02fdea1-e523-417c-b9fe-aea38c48234e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:45.398446 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c02fdea1-e523-417c-b9fe-aea38c48234e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:45.399141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c02fdea1-e523-417c-b9fe-aea38c48234e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:45.399695 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c02fdea1-e523-417c-b9fe-aea38c48234e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:45.400236 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c02fdea1-e523-417c-b9fe-aea38c48234e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:45.405293 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c02fdea1-e523-417c-b9fe-aea38c48234e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:45.583718 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c02fdea1-e523-417c-b9fe-aea38c48234e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:45.591618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c02fdea1-e523-417c-b9fe-aea38c48234e tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1513 microversion: 2.1 time: 0.205870 Sep 06 04:41:45.592194 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 314/648] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:45 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1513 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:45.815573 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-9db1ed77-4e88-4fdf-8222-ca80234d14d2 req-bc64d844-e8f8-4bde-9209-d28f91863a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe", "name": "network-vif-deleted", "tag": "a0ca313c-cb22-419f-a33b-5f2b11961726"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:41:45.825235 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9db1ed77-4e88-4fdf-8222-ca80234d14d2 req-bc64d844-e8f8-4bde-9209-d28f91863a6f service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:45.830985 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9db1ed77-4e88-4fdf-8222-ca80234d14d2 req-bc64d844-e8f8-4bde-9209-d28f91863a6f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:45.830985 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9db1ed77-4e88-4fdf-8222-ca80234d14d2 req-bc64d844-e8f8-4bde-9209-d28f91863a6f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:45.836929 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-9db1ed77-4e88-4fdf-8222-ca80234d14d2 req-bc64d844-e8f8-4bde-9209-d28f91863a6f service nova] Creating event network-vif-deleted:a0ca313c-cb22-419f-a33b-5f2b11961726 for instance 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe on hv-cinder-85600 Sep 06 04:41:45.842096 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-9db1ed77-4e88-4fdf-8222-ca80234d14d2 req-bc64d844-e8f8-4bde-9209-d28f91863a6f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083954 Sep 06 04:41:45.843351 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 335/649] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:41:46.222527 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ff2715fa-2eec-4132-bce3-b35cad110566 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:46.223054 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ff2715fa-2eec-4132-bce3-b35cad110566 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:46.224895 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=36 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:41:46.230152 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff2715fa-2eec-4132-bce3-b35cad110566 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:46.230633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff2715fa-2eec-4132-bce3-b35cad110566 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:46.231086 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff2715fa-2eec-4132-bce3-b35cad110566 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:46.231951 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff2715fa-2eec-4132-bce3-b35cad110566 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:46.232251 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff2715fa-2eec-4132-bce3-b35cad110566 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:46.232667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff2715fa-2eec-4132-bce3-b35cad110566 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:46.362891 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ff2715fa-2eec-4132-bce3-b35cad110566 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:46.371192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ff2715fa-2eec-4132-bce3-b35cad110566 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1722 microversion: 2.1 time: 0.153564 Sep 06 04:41:46.371759 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 315/650] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:46 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:46.616843 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-727eaeb0-e2b1-48da-b6d7-636140f3a193 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:46.617793 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-727eaeb0-e2b1-48da-b6d7-636140f3a193 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:46.624379 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-727eaeb0-e2b1-48da-b6d7-636140f3a193 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:46.624870 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-727eaeb0-e2b1-48da-b6d7-636140f3a193 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:46.625486 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-727eaeb0-e2b1-48da-b6d7-636140f3a193 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:46.626180 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-727eaeb0-e2b1-48da-b6d7-636140f3a193 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:46.626640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-727eaeb0-e2b1-48da-b6d7-636140f3a193 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:46.627086 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-727eaeb0-e2b1-48da-b6d7-636140f3a193 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:46.662389 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-727eaeb0-e2b1-48da-b6d7-636140f3a193 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:46.662876 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-727eaeb0-e2b1-48da-b6d7-636140f3a193 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:46.663313 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-727eaeb0-e2b1-48da-b6d7-636140f3a193 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:46.663764 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-727eaeb0-e2b1-48da-b6d7-636140f3a193 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lazy-loading 'fault' on Instance uuid 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:41:46.705717 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-727eaeb0-e2b1-48da-b6d7-636140f3a193 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '784815b8c6d0400c92caa54981b137d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36495849f5124872ba74fe21b00f72fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:46.713397 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-727eaeb0-e2b1-48da-b6d7-636140f3a193 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 200 len: 1309 microversion: 2.1 time: 0.101201 Sep 06 04:41:46.713968 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 336/651] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:46 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:47.396443 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e915d75d-756c-48cd-a476-2a72baa15c99 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:47.397054 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e915d75d-756c-48cd-a476-2a72baa15c99 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:47.403507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e915d75d-756c-48cd-a476-2a72baa15c99 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:47.403989 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e915d75d-756c-48cd-a476-2a72baa15c99 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:47.404424 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e915d75d-756c-48cd-a476-2a72baa15c99 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:47.405132 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e915d75d-756c-48cd-a476-2a72baa15c99 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:47.405871 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e915d75d-756c-48cd-a476-2a72baa15c99 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:47.406303 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e915d75d-756c-48cd-a476-2a72baa15c99 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:47.544260 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e915d75d-756c-48cd-a476-2a72baa15c99 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:41:47.552586 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e915d75d-756c-48cd-a476-2a72baa15c99 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1728 microversion: 2.1 time: 0.160028 Sep 06 04:41:47.554289 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 316/652] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:47 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:41:47.575730 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-250dcbed-72a0-4825-b34e-2b493d721f4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:47.576216 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-250dcbed-72a0-4825-b34e-2b493d721f4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:47.583835 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-250dcbed-72a0-4825-b34e-2b493d721f4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:47.590754 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-250dcbed-72a0-4825-b34e-2b493d721f4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:47.590754 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-250dcbed-72a0-4825-b34e-2b493d721f4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:47.590754 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-250dcbed-72a0-4825-b34e-2b493d721f4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:47.590754 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-250dcbed-72a0-4825-b34e-2b493d721f4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:47.591216 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-250dcbed-72a0-4825-b34e-2b493d721f4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:47.663133 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-250dcbed-72a0-4825-b34e-2b493d721f4c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091198 Sep 06 04:41:47.663925 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 337/653] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Sep 6 04:41:47 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:41:47.736119 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e30d27ea-ee6f-4ee5-b4c9-a41d228e4e26 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:41:47.736730 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e30d27ea-ee6f-4ee5-b4c9-a41d228e4e26 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] [instance: 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:41:47.742714 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e30d27ea-ee6f-4ee5-b4c9-a41d228e4e26 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:47.743279 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e30d27ea-ee6f-4ee5-b4c9-a41d228e4e26 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:47.743723 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e30d27ea-ee6f-4ee5-b4c9-a41d228e4e26 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:47.744433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e30d27ea-ee6f-4ee5-b4c9-a41d228e4e26 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:47.745000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e30d27ea-ee6f-4ee5-b4c9-a41d228e4e26 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:47.746387 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e30d27ea-ee6f-4ee5-b4c9-a41d228e4e26 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:47.762456 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-e30d27ea-ee6f-4ee5-b4c9-a41d228e4e26 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] HTTP exception thrown: Instance 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe could not be found. Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e30d27ea-ee6f-4ee5-b4c9-a41d228e4e26 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Request method failure captured: Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe HTTP/1.1 Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs67Cer-d-mOhP7dkvMjwIj7aEDLffOVUly7QPXVx6qkKQHxll4jozXWYPrETF-RhTSJGyM-MPF8WMC-QzPLcFnJ7OcEOR-WANlzVCC7Dig37b-z92Z24eGtYYQMKQQ2deRrfRSiVhag8uYmBPLNDXz0qROT8IaGL88Iv4zSr98vr2M Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 36495849f5124872ba74fe21b00f72fe Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1413552789 Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:41:47.763984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:41:47.765442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/36495849f5124872ba74fe21b00f72fe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/36495849f5124872ba74fe21b00f72fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_36495849f5124872ba74fe21b00f72fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/36495849f5124872ba74fe21b00f72fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:41:47.765442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesSnapshotTestJSON-1413552789 Sep 06 04:41:47.765442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 36495849f5124872ba74fe21b00f72fe Sep 06 04:41:47.765442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1413552789 Sep 06 04:41:47.765442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesSnapshotTestJSON-1413552789-project Sep 06 04:41:47.765442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:41:47.765442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:41:47.765442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 784815b8c6d0400c92caa54981b137d9 Sep 06 04:41:47.765442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesSnapshotTestJSON-1413552789-project Sep 06 04:41:47.765442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:41:47.765442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe could not be found. Sep 06 04:41:47.765442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe'} Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe could not be found. Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:41:47.766198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe could not be found. Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe could not be found. Sep 06 04:41:47.767384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:41:47.768494 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e30d27ea-ee6f-4ee5-b4c9-a41d228e4e26 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] Returning 404 to user: Instance 8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:41:47.768494 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e30d27ea-ee6f-4ee5-b4c9-a41d228e4e26 tempest-VolumesSnapshotTestJSON-1413552789 tempest-VolumesSnapshotTestJSON-1413552789-project] 10.222.0.30 "GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe" status: 404 len: 111 microversion: 2.1 time: 0.033306 Sep 06 04:41:47.768494 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 317/654] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:41:47 2022] GET /compute/v2.1/servers/8453f1e7-b97f-4d70-8e3a-ab98f2b64fbe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:41:48.664207 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-1b1961f7-346a-47a2-8bf3-86dab302b19d req-30f7e990-cbf4-44c7-9597-44180115e13c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4631439d-ba1a-4895-88bc-66f83e93defa", "tag": "6c3db147-6601-4ab0-a362-ff2c28ef3252"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:41:48.674635 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-1b1961f7-346a-47a2-8bf3-86dab302b19d req-30f7e990-cbf4-44c7-9597-44180115e13c service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:48.675110 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-1b1961f7-346a-47a2-8bf3-86dab302b19d req-30f7e990-cbf4-44c7-9597-44180115e13c service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:48.675535 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-1b1961f7-346a-47a2-8bf3-86dab302b19d req-30f7e990-cbf4-44c7-9597-44180115e13c service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:48.687322 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-1b1961f7-346a-47a2-8bf3-86dab302b19d req-30f7e990-cbf4-44c7-9597-44180115e13c service nova] Creating event network-changed:6c3db147-6601-4ab0-a362-ff2c28ef3252 for instance 4631439d-ba1a-4895-88bc-66f83e93defa on hv-cinder-85600 Sep 06 04:41:48.692335 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-1b1961f7-346a-47a2-8bf3-86dab302b19d req-30f7e990-cbf4-44c7-9597-44180115e13c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095422 Sep 06 04:41:48.693090 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 338/655] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:41:50.707691 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-c9aeee0e-5cba-4dff-958c-4b021507bcca req-156e734f-c0a4-4340-82b7-100c7817e1a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4631439d-ba1a-4895-88bc-66f83e93defa", "tag": "6c3db147-6601-4ab0-a362-ff2c28ef3252"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:41:50.718602 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-c9aeee0e-5cba-4dff-958c-4b021507bcca req-156e734f-c0a4-4340-82b7-100c7817e1a0 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:41:50.719081 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-c9aeee0e-5cba-4dff-958c-4b021507bcca req-156e734f-c0a4-4340-82b7-100c7817e1a0 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:41:50.719498 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-c9aeee0e-5cba-4dff-958c-4b021507bcca req-156e734f-c0a4-4340-82b7-100c7817e1a0 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:41:50.730822 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-c9aeee0e-5cba-4dff-958c-4b021507bcca req-156e734f-c0a4-4340-82b7-100c7817e1a0 service nova] Creating event network-changed:6c3db147-6601-4ab0-a362-ff2c28ef3252 for instance 4631439d-ba1a-4895-88bc-66f83e93defa on hv-cinder-85600 Sep 06 04:41:50.737415 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-c9aeee0e-5cba-4dff-958c-4b021507bcca req-156e734f-c0a4-4340-82b7-100c7817e1a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033269 Sep 06 04:41:50.738068 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 318/656] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:42:02.298719 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=15 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:02.299452 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:02.412639 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-42ef0333-52ce-4380-ad6b-675f167c2668 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:02.413233 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-42ef0333-52ce-4380-ad6b-675f167c2668 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:02.419842 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-42ef0333-52ce-4380-ad6b-675f167c2668 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:02.420328 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-42ef0333-52ce-4380-ad6b-675f167c2668 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:02.420767 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-42ef0333-52ce-4380-ad6b-675f167c2668 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:02.421542 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-42ef0333-52ce-4380-ad6b-675f167c2668 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:02.422019 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-42ef0333-52ce-4380-ad6b-675f167c2668 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:02.422469 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-42ef0333-52ce-4380-ad6b-675f167c2668 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:02.448982 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-42ef0333-52ce-4380-ad6b-675f167c2668 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869/ips" status: 200 len: 150 microversion: 2.1 time: 0.152552 Sep 06 04:42:02.449565 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 339/657] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Sep 6 04:42:02 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869/ips => generated 150 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:42:02.458866 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=7 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:02.459683 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=37 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:02.463879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0210863d-9c0f-425c-ba5c-43c6646a6447 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d7130f6-93c5-4f9a-a091-e2b543452b33"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:42:02.466274 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0210863d-9c0f-425c-ba5c-43c6646a6447 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:02.472755 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0210863d-9c0f-425c-ba5c-43c6646a6447 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:02.473230 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0210863d-9c0f-425c-ba5c-43c6646a6447 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:02.473688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0210863d-9c0f-425c-ba5c-43c6646a6447 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:02.474436 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0210863d-9c0f-425c-ba5c-43c6646a6447 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:02.474890 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0210863d-9c0f-425c-ba5c-43c6646a6447 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:02.475306 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0210863d-9c0f-425c-ba5c-43c6646a6447 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:02.554590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-0210863d-9c0f-425c-ba5c-43c6646a6447 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] HTTP exception thrown: Invalid volume: volume 3d7130f6-93c5-4f9a-a091-e2b543452b33 is already attached to instances: 655e54ca-b46d-40ea-a544-c796990772d7 Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0210863d-9c0f-425c-ba5c-43c6646a6447 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Request method failure captured: Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: POST /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869/os-volume_attachments HTTP/1.1 Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 74 Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4RQ2W0jAEqmIc2a2gyZUln8p5bNCm0_mI8D5F27-XVkP7ATAOu468pXcxlEjqoKhC2riGskVgaopgp2mx1B-_JnDX9K5NgGMMIQuXdxY4mBudlKUObSTI_UiuCCeDA5-u77rF7VJ2ZfC_NCmQ-YCsbSULwwvYBOkysYcpX20qWbNI Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:42:02.556266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:42:02.557839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d04ba57221f42d684873d624dbfd283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:42:02.557839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:42:02.557839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:42:02.557839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:42:02.557839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:42:02.557839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:42:02.557839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:42:02.557839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 5a0294ea40914bf290902307a787642d Sep 06 04:42:02.557839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:42:02.557839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Sep 06 04:42:02.557839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {"volumeAttachment": {"volumeId": "3d7130f6-93c5-4f9a-a091-e2b543452b33"}} Sep 06 04:42:02.557839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Invalid volume: volume 3d7130f6-93c5-4f9a-a091-e2b543452b33 is already attached to instances: 655e54ca-b46d-40ea-a544-c796990772d7 Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'server_id': '16044770-064c-404f-9a5e-c3c493e8a869', 'body': {'volumeAttachment': {'volumeId': '3d7130f6-93c5-4f9a-a091-e2b543452b33'}}} Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3d7130f6-93c5-4f9a-a091-e2b543452b33 is already attached to instances: 655e54ca-b46d-40ea-a544-c796990772d7 Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:42:02.561762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3d7130f6-93c5-4f9a-a091-e2b543452b33 is already attached to instances: 655e54ca-b46d-40ea-a544-c796990772d7 Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:42:02.563365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:42:02.564975 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:42:02.564975 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:42:02.564975 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:42:02.564975 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3d7130f6-93c5-4f9a-a091-e2b543452b33 is already attached to instances: 655e54ca-b46d-40ea-a544-c796990772d7 Sep 06 04:42:02.564975 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:42:02.564975 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0210863d-9c0f-425c-ba5c-43c6646a6447 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Returning 400 to user: Invalid volume: volume 3d7130f6-93c5-4f9a-a091-e2b543452b33 is already attached to instances: 655e54ca-b46d-40ea-a544-c796990772d7 {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:42:02.564975 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0210863d-9c0f-425c-ba5c-43c6646a6447 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "POST /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100427 Sep 06 04:42:02.564975 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 319/658] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Sep 6 04:42:02 2022] POST /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 04:42:02.567727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0d09e0b6-5d33-495d-8fa3-950ccdc909c1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:02.568215 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0d09e0b6-5d33-495d-8fa3-950ccdc909c1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:02.574131 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d09e0b6-5d33-495d-8fa3-950ccdc909c1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:02.574604 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d09e0b6-5d33-495d-8fa3-950ccdc909c1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:02.575059 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d09e0b6-5d33-495d-8fa3-950ccdc909c1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:02.575729 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d09e0b6-5d33-495d-8fa3-950ccdc909c1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:02.576178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d09e0b6-5d33-495d-8fa3-950ccdc909c1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:02.576592 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0d09e0b6-5d33-495d-8fa3-950ccdc909c1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:02.603051 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0d09e0b6-5d33-495d-8fa3-950ccdc909c1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:42:02.942570 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0d09e0b6-5d33-495d-8fa3-950ccdc909c1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "DELETE /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 204 len: 0 microversion: 2.1 time: 0.378356 Sep 06 04:42:02.943078 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 340/659] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:42:02 2022] DELETE /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:42:02.951179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-65f00f78-b8c7-487f-b0df-1733850e0c9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:02.951704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-65f00f78-b8c7-487f-b0df-1733850e0c9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:02.958982 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-65f00f78-b8c7-487f-b0df-1733850e0c9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:02.959465 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-65f00f78-b8c7-487f-b0df-1733850e0c9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:02.960040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-65f00f78-b8c7-487f-b0df-1733850e0c9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:02.960553 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-65f00f78-b8c7-487f-b0df-1733850e0c9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:02.960996 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-65f00f78-b8c7-487f-b0df-1733850e0c9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:02.961441 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-65f00f78-b8c7-487f-b0df-1733850e0c9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:03.090118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-65f00f78-b8c7-487f-b0df-1733850e0c9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:03.098397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-65f00f78-b8c7-487f-b0df-1733850e0c9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1683 microversion: 2.1 time: 0.151181 Sep 06 04:42:03.098958 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 320/660] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:02 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:04.122311 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-88d265df-5d53-41d8-88a9-2c0f258ac365 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:04.123005 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-88d265df-5d53-41d8-88a9-2c0f258ac365 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:04.129961 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88d265df-5d53-41d8-88a9-2c0f258ac365 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:04.130443 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88d265df-5d53-41d8-88a9-2c0f258ac365 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:04.130879 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88d265df-5d53-41d8-88a9-2c0f258ac365 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:04.131556 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88d265df-5d53-41d8-88a9-2c0f258ac365 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:04.132010 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88d265df-5d53-41d8-88a9-2c0f258ac365 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:04.132428 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-88d265df-5d53-41d8-88a9-2c0f258ac365 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:04.260657 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-88d265df-5d53-41d8-88a9-2c0f258ac365 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:04.268385 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-88d265df-5d53-41d8-88a9-2c0f258ac365 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1683 microversion: 2.1 time: 0.150281 Sep 06 04:42:04.268947 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 341/661] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:04 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:05.291829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-689ab683-e1f1-4a0e-9e55-0469c78623e6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:05.292459 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-689ab683-e1f1-4a0e-9e55-0469c78623e6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:05.299709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-689ab683-e1f1-4a0e-9e55-0469c78623e6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:05.300175 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-689ab683-e1f1-4a0e-9e55-0469c78623e6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:05.300600 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-689ab683-e1f1-4a0e-9e55-0469c78623e6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:05.301271 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-689ab683-e1f1-4a0e-9e55-0469c78623e6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:05.302101 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-689ab683-e1f1-4a0e-9e55-0469c78623e6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:05.302527 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-689ab683-e1f1-4a0e-9e55-0469c78623e6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:05.431413 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-689ab683-e1f1-4a0e-9e55-0469c78623e6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:05.439640 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-689ab683-e1f1-4a0e-9e55-0469c78623e6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1683 microversion: 2.1 time: 0.151633 Sep 06 04:42:05.440197 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 321/662] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:05 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:06.462860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6c2c00dd-725b-4ac6-b72c-23d48d772f9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:06.565757 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6c2c00dd-725b-4ac6-b72c-23d48d772f9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:06.565757 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c2c00dd-725b-4ac6-b72c-23d48d772f9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:06.565757 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c2c00dd-725b-4ac6-b72c-23d48d772f9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:06.565757 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c2c00dd-725b-4ac6-b72c-23d48d772f9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:06.566767 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c2c00dd-725b-4ac6-b72c-23d48d772f9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:06.566767 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c2c00dd-725b-4ac6-b72c-23d48d772f9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:06.566767 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6c2c00dd-725b-4ac6-b72c-23d48d772f9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:06.613337 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6c2c00dd-725b-4ac6-b72c-23d48d772f9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:06.620961 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6c2c00dd-725b-4ac6-b72c-23d48d772f9d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1683 microversion: 2.1 time: 0.162127 Sep 06 04:42:06.621536 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 342/663] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:06 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:07.644242 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a7b4ff13-16e9-472b-9048-cee13fe3af79 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:07.644771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a7b4ff13-16e9-472b-9048-cee13fe3af79 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:07.651257 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7b4ff13-16e9-472b-9048-cee13fe3af79 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:07.651731 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7b4ff13-16e9-472b-9048-cee13fe3af79 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:07.652158 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7b4ff13-16e9-472b-9048-cee13fe3af79 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:07.653144 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7b4ff13-16e9-472b-9048-cee13fe3af79 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:07.653624 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7b4ff13-16e9-472b-9048-cee13fe3af79 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:07.654106 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a7b4ff13-16e9-472b-9048-cee13fe3af79 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:07.783827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a7b4ff13-16e9-472b-9048-cee13fe3af79 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:07.791433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a7b4ff13-16e9-472b-9048-cee13fe3af79 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1683 microversion: 2.1 time: 0.151239 Sep 06 04:42:07.791988 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 322/664] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:07 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:08.815462 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-140e2459-e9f9-4053-a095-0d0093711386 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:08.816714 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-140e2459-e9f9-4053-a095-0d0093711386 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:08.822843 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-140e2459-e9f9-4053-a095-0d0093711386 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:08.823353 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-140e2459-e9f9-4053-a095-0d0093711386 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:08.823774 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-140e2459-e9f9-4053-a095-0d0093711386 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:08.824468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-140e2459-e9f9-4053-a095-0d0093711386 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:08.824924 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-140e2459-e9f9-4053-a095-0d0093711386 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:08.825375 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-140e2459-e9f9-4053-a095-0d0093711386 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:08.959766 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-140e2459-e9f9-4053-a095-0d0093711386 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:08.967533 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-140e2459-e9f9-4053-a095-0d0093711386 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1683 microversion: 2.1 time: 0.156275 Sep 06 04:42:08.968103 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 343/665] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:08 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:09.583544 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-0bf58b37-c573-4d0b-8f96-17b57440156e req-41806aa5-ed47-4e19-9702-a5b1bf39f1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16044770-064c-404f-9a5e-c3c493e8a869", "name": "network-vif-deleted", "tag": "b5526f44-d0dc-4158-98ba-041cc793f4d7"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:42:09.598928 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0bf58b37-c573-4d0b-8f96-17b57440156e req-41806aa5-ed47-4e19-9702-a5b1bf39f1fb service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:09.598928 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0bf58b37-c573-4d0b-8f96-17b57440156e req-41806aa5-ed47-4e19-9702-a5b1bf39f1fb service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:09.598928 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0bf58b37-c573-4d0b-8f96-17b57440156e req-41806aa5-ed47-4e19-9702-a5b1bf39f1fb service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:09.607080 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-0bf58b37-c573-4d0b-8f96-17b57440156e req-41806aa5-ed47-4e19-9702-a5b1bf39f1fb service nova] Creating event network-vif-deleted:b5526f44-d0dc-4158-98ba-041cc793f4d7 for instance 16044770-064c-404f-9a5e-c3c493e8a869 on hv-cinder-85600 Sep 06 04:42:09.612920 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-0bf58b37-c573-4d0b-8f96-17b57440156e req-41806aa5-ed47-4e19-9702-a5b1bf39f1fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034178 Sep 06 04:42:09.613646 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 323/666] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:42:09.994716 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5e884985-7f3f-4950-9758-6e25a6322bc7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:09.995937 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5e884985-7f3f-4950-9758-6e25a6322bc7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:10.003635 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5e884985-7f3f-4950-9758-6e25a6322bc7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:10.004439 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5e884985-7f3f-4950-9758-6e25a6322bc7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:10.005099 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5e884985-7f3f-4950-9758-6e25a6322bc7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:10.006010 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5e884985-7f3f-4950-9758-6e25a6322bc7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:10.006616 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5e884985-7f3f-4950-9758-6e25a6322bc7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:10.007187 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5e884985-7f3f-4950-9758-6e25a6322bc7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:10.044083 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5e884985-7f3f-4950-9758-6e25a6322bc7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:10.044832 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5e884985-7f3f-4950-9758-6e25a6322bc7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:10.045441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5e884985-7f3f-4950-9758-6e25a6322bc7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:10.046036 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-5e884985-7f3f-4950-9758-6e25a6322bc7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lazy-loading 'fault' on Instance uuid 16044770-064c-404f-9a5e-c3c493e8a869 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:42:10.089457 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5e884985-7f3f-4950-9758-6e25a6322bc7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:10.098170 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5e884985-7f3f-4950-9758-6e25a6322bc7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 200 len: 1332 microversion: 2.1 time: 0.108115 Sep 06 04:42:10.098737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 344/667] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:09 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:11.129072 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d175f36e-19ae-4c2d-9a26-8257a89aadac tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:11.129819 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d175f36e-19ae-4c2d-9a26-8257a89aadac tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:11.136420 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d175f36e-19ae-4c2d-9a26-8257a89aadac tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:11.136930 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d175f36e-19ae-4c2d-9a26-8257a89aadac tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:11.137388 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d175f36e-19ae-4c2d-9a26-8257a89aadac tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:11.138080 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d175f36e-19ae-4c2d-9a26-8257a89aadac tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:11.138718 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d175f36e-19ae-4c2d-9a26-8257a89aadac tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:11.139137 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d175f36e-19ae-4c2d-9a26-8257a89aadac tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:11.153422 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-d175f36e-19ae-4c2d-9a26-8257a89aadac tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] HTTP exception thrown: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d175f36e-19ae-4c2d-9a26-8257a89aadac tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Request method failure captured: Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 HTTP/1.1 Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4RQ2W0jAEqmIc2a2gyZUln8p5bNCm0_mI8D5F27-XVkP7ATAOu468pXcxlEjqoKhC2riGskVgaopgp2mx1B-_JnDX9K5NgGMMIQuXdxY4mBudlKUObSTI_UiuCCeDA5-u77rF7VJ2ZfC_NCmQ-YCsbSULwwvYBOkysYcpX20qWbNI Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:42:11.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:42:11.156716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d04ba57221f42d684873d624dbfd283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:42:11.156716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:42:11.156716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:42:11.156716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:42:11.156716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:42:11.156716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:42:11.156716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:42:11.156716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 5a0294ea40914bf290902307a787642d Sep 06 04:42:11.156716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:42:11.156716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:42:11.156716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. Sep 06 04:42:11.156716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '16044770-064c-404f-9a5e-c3c493e8a869'} Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:42:11.158343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. Sep 06 04:42:11.159704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:42:11.160820 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d175f36e-19ae-4c2d-9a26-8257a89aadac tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Returning 404 to user: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:42:11.160820 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d175f36e-19ae-4c2d-9a26-8257a89aadac tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 404 len: 111 microversion: 2.1 time: 0.032594 Sep 06 04:42:11.161241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 324/668] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:11 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:42:11.167085 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7a9cdf3d-feff-4f4a-8939-9897fa061c4c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '.version_select at 0x7f3176503040>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:11.252072 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7a9cdf3d-feff-4f4a-8939-9897fa061c4c tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056577452" status: 202 len: 0 microversion: 2.1 time: 0.089345 Sep 06 04:42:11.252711 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 345/669] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Sep 6 04:42:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2056577452 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:42:12.086080 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-370292f4-3252-4bd2-b0b0-ad038596d051 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:12.086568 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-370292f4-3252-4bd2-b0b0-ad038596d051 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:12.092444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-370292f4-3252-4bd2-b0b0-ad038596d051 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:12.092917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-370292f4-3252-4bd2-b0b0-ad038596d051 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:12.093383 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-370292f4-3252-4bd2-b0b0-ad038596d051 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:12.094056 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-370292f4-3252-4bd2-b0b0-ad038596d051 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:12.095227 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-370292f4-3252-4bd2-b0b0-ad038596d051 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:12.095650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-370292f4-3252-4bd2-b0b0-ad038596d051 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:12.191889 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-370292f4-3252-4bd2-b0b0-ad038596d051 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lazy-loading 'services' on Instance uuid 655e54ca-b46d-40ea-a544-c796990772d7 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:42:12.363679 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-370292f4-3252-4bd2-b0b0-ad038596d051 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "DELETE /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7/os-volume_attachments/3d7130f6-93c5-4f9a-a091-e2b543452b33" status: 202 len: 0 microversion: 2.1 time: 0.281176 Sep 06 04:42:12.364267 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 325/670] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Sep 6 04:42:12 2022] DELETE /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7/os-volume_attachments/3d7130f6-93c5-4f9a-a091-e2b543452b33 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:42:12.373503 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a14e6c6e-9237-45b3-87e4-11cf65906a05 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:12.376113 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a14e6c6e-9237-45b3-87e4-11cf65906a05 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:12.383363 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a14e6c6e-9237-45b3-87e4-11cf65906a05 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:12.383852 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a14e6c6e-9237-45b3-87e4-11cf65906a05 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:12.384289 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a14e6c6e-9237-45b3-87e4-11cf65906a05 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:12.384987 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a14e6c6e-9237-45b3-87e4-11cf65906a05 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:12.386890 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a14e6c6e-9237-45b3-87e4-11cf65906a05 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:12.386890 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a14e6c6e-9237-45b3-87e4-11cf65906a05 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:12.421339 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a14e6c6e-9237-45b3-87e4-11cf65906a05 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049646 Sep 06 04:42:12.421339 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 346/671] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:42:12 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:42:13.433360 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-aa79aa39-e2a3-42b4-9831-5fc3a5f57294 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:13.435647 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-aa79aa39-e2a3-42b4-9831-5fc3a5f57294 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:13.442269 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa79aa39-e2a3-42b4-9831-5fc3a5f57294 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:13.442750 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa79aa39-e2a3-42b4-9831-5fc3a5f57294 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:13.443186 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa79aa39-e2a3-42b4-9831-5fc3a5f57294 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:13.443873 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa79aa39-e2a3-42b4-9831-5fc3a5f57294 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:13.444325 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa79aa39-e2a3-42b4-9831-5fc3a5f57294 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:13.444747 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa79aa39-e2a3-42b4-9831-5fc3a5f57294 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:13.476426 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-aa79aa39-e2a3-42b4-9831-5fc3a5f57294 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048137 Sep 06 04:42:13.476966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 326/672] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:42:13 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:42:14.490054 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c15c0b4e-ff1f-438f-927a-3ae4e43989b4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:14.492167 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c15c0b4e-ff1f-438f-927a-3ae4e43989b4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:14.499484 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c15c0b4e-ff1f-438f-927a-3ae4e43989b4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:14.499484 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c15c0b4e-ff1f-438f-927a-3ae4e43989b4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:14.499484 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c15c0b4e-ff1f-438f-927a-3ae4e43989b4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:14.499881 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c15c0b4e-ff1f-438f-927a-3ae4e43989b4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:14.500329 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c15c0b4e-ff1f-438f-927a-3ae4e43989b4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:14.500959 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c15c0b4e-ff1f-438f-927a-3ae4e43989b4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:14.529942 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c15c0b4e-ff1f-438f-927a-3ae4e43989b4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045017 Sep 06 04:42:14.532757 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 347/673] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:42:14 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 04:42:14.594116 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-83b2d2d8-469b-44ea-9f05-9b10287abdea tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:14.595547 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-83b2d2d8-469b-44ea-9f05-9b10287abdea tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:14.597921 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 04:42:14.598074 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Tue Sep 6 04:42:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 (ip 10.222.0.30) !!! Sep 06 04:42:14.605066 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83b2d2d8-469b-44ea-9f05-9b10287abdea tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:14.605575 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83b2d2d8-469b-44ea-9f05-9b10287abdea tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:14.606002 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83b2d2d8-469b-44ea-9f05-9b10287abdea tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:14.606685 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83b2d2d8-469b-44ea-9f05-9b10287abdea tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:14.607132 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83b2d2d8-469b-44ea-9f05-9b10287abdea tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:14.607552 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-83b2d2d8-469b-44ea-9f05-9b10287abdea tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:14.633653 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-83b2d2d8-469b-44ea-9f05-9b10287abdea tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:42:14.908089 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-83b2d2d8-469b-44ea-9f05-9b10287abdea tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "DELETE /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 204 len: 0 microversion: 2.1 time: 0.317421 Sep 06 04:42:14.908670 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 327/674] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:42:14 2022] DELETE /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:42:14.916669 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fd6c12f9-b639-4480-bec6-95a4e321d28f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:14.917406 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fd6c12f9-b639-4480-bec6-95a4e321d28f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:14.924584 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd6c12f9-b639-4480-bec6-95a4e321d28f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:14.925068 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd6c12f9-b639-4480-bec6-95a4e321d28f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:14.925531 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd6c12f9-b639-4480-bec6-95a4e321d28f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:14.926222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd6c12f9-b639-4480-bec6-95a4e321d28f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:14.926741 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd6c12f9-b639-4480-bec6-95a4e321d28f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:14.927183 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd6c12f9-b639-4480-bec6-95a4e321d28f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:15.056986 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fd6c12f9-b639-4480-bec6-95a4e321d28f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:15.065381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fd6c12f9-b639-4480-bec6-95a4e321d28f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1682 microversion: 2.1 time: 0.152442 Sep 06 04:42:15.065939 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 348/675] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:14 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:16.092530 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eff440fc-4c58-4286-a35c-bd182602bca7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:16.093366 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-eff440fc-4c58-4286-a35c-bd182602bca7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:16.100262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eff440fc-4c58-4286-a35c-bd182602bca7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:16.100754 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eff440fc-4c58-4286-a35c-bd182602bca7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:16.101188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eff440fc-4c58-4286-a35c-bd182602bca7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:16.101919 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eff440fc-4c58-4286-a35c-bd182602bca7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:16.102368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eff440fc-4c58-4286-a35c-bd182602bca7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:16.102790 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eff440fc-4c58-4286-a35c-bd182602bca7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:16.515719 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eff440fc-4c58-4286-a35c-bd182602bca7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:16.524361 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-eff440fc-4c58-4286-a35c-bd182602bca7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1682 microversion: 2.1 time: 0.436143 Sep 06 04:42:16.528547 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 328/676] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:16 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1682 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:17.274200 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-c7f50ce4-4313-4177-a19a-9db5edbf4aa3 req-946b4918-0b29-4f36-939a-1fe8a8c5b16c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "655e54ca-b46d-40ea-a544-c796990772d7", "name": "network-vif-deleted", "tag": "f88cebc5-b6a7-4ea8-9133-58a12f404543"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:42:17.279951 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 04:42:17.280270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Tue Sep 6 04:42:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.30) !!! Sep 06 04:42:17.286950 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c7f50ce4-4313-4177-a19a-9db5edbf4aa3 req-946b4918-0b29-4f36-939a-1fe8a8c5b16c service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:17.287426 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c7f50ce4-4313-4177-a19a-9db5edbf4aa3 req-946b4918-0b29-4f36-939a-1fe8a8c5b16c service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:17.287846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-c7f50ce4-4313-4177-a19a-9db5edbf4aa3 req-946b4918-0b29-4f36-939a-1fe8a8c5b16c service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:17.302003 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-c7f50ce4-4313-4177-a19a-9db5edbf4aa3 req-946b4918-0b29-4f36-939a-1fe8a8c5b16c service nova] Creating event network-vif-deleted:f88cebc5-b6a7-4ea8-9133-58a12f404543 for instance 655e54ca-b46d-40ea-a544-c796990772d7 on hv-cinder-85600 Sep 06 04:42:17.306732 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-c7f50ce4-4313-4177-a19a-9db5edbf4aa3 req-946b4918-0b29-4f36-939a-1fe8a8c5b16c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036302 Sep 06 04:42:17.307414 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 349/677] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:42:17.550272 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b634b42b-3d1e-4301-81ca-053f2157910a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:17.553017 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b634b42b-3d1e-4301-81ca-053f2157910a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:17.558617 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b634b42b-3d1e-4301-81ca-053f2157910a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:17.559104 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b634b42b-3d1e-4301-81ca-053f2157910a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:17.559532 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b634b42b-3d1e-4301-81ca-053f2157910a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:17.560221 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b634b42b-3d1e-4301-81ca-053f2157910a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:17.560857 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b634b42b-3d1e-4301-81ca-053f2157910a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:17.561063 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b634b42b-3d1e-4301-81ca-053f2157910a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:17.624158 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b634b42b-3d1e-4301-81ca-053f2157910a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:17.635540 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b634b42b-3d1e-4301-81ca-053f2157910a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 200 len: 1326 microversion: 2.1 time: 0.089264 Sep 06 04:42:17.636487 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 329/678] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:17 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 1326 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:18.664536 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e76069d9-514c-4db6-b20c-0b9413d181d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:18.665381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e76069d9-514c-4db6-b20c-0b9413d181d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:18.673049 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e76069d9-514c-4db6-b20c-0b9413d181d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:18.678019 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e76069d9-514c-4db6-b20c-0b9413d181d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:18.678019 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e76069d9-514c-4db6-b20c-0b9413d181d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:18.678019 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e76069d9-514c-4db6-b20c-0b9413d181d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:18.678019 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e76069d9-514c-4db6-b20c-0b9413d181d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:18.678357 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e76069d9-514c-4db6-b20c-0b9413d181d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:18.689021 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-e76069d9-514c-4db6-b20c-0b9413d181d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] HTTP exception thrown: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e76069d9-514c-4db6-b20c-0b9413d181d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Request method failure captured: Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 HTTP/1.1 Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs4RQ2W0jAEqmIc2a2gyZUln8p5bNCm0_mI8D5F27-XVkP7ATAOu468pXcxlEjqoKhC2riGskVgaopgp2mx1B-_JnDX9K5NgGMMIQuXdxY4mBudlKUObSTI_UiuCCeDA5-u77rF7VJ2ZfC_NCmQ-YCsbSULwwvYBOkysYcpX20qWbNI Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:42:18.690702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:42:18.692227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d04ba57221f42d684873d624dbfd283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:42:18.692227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:42:18.692227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:42:18.692227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:42:18.692227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:42:18.692227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:42:18.692227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:42:18.692227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 5a0294ea40914bf290902307a787642d Sep 06 04:42:18.692227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:42:18.692227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:42:18.692227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. Sep 06 04:42:18.692227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '655e54ca-b46d-40ea-a544-c796990772d7'} Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:42:18.693108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. Sep 06 04:42:18.697737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:42:18.699033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e76069d9-514c-4db6-b20c-0b9413d181d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Returning 404 to user: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:42:18.699033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e76069d9-514c-4db6-b20c-0b9413d181d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 404 len: 111 microversion: 2.1 time: 0.032497 Sep 06 04:42:18.699033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 350/679] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:18 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:42:18.701106 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5f0a327b-05f2-4291-94c8-855cb10bdba7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '.version_select at 0x7f31764dd310>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:18.786813 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5f0a327b-05f2-4291-94c8-855cb10bdba7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-633779473" status: 202 len: 0 microversion: 2.1 time: 0.089435 Sep 06 04:42:18.787482 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 330/680] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Sep 6 04:42:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-633779473 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:42:19.667696 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3198f902-8153-46aa-854a-b7cfed70ccf1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Action: 'create', calling method: .version_select at 0x7f31764b7ee0>, body: {"keypair": {"name": "tempest-keypair-1240146963", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4rkiPAhw3NG/xmK6QseQhZFJh5zTQ/n+uUnJjddOsF3sMF35MPMKuKM3MbV8M5g2aZpl5ZKlwZsF2Rqs6Kr/SpYa7eW7EgLkplXArJPrduEreGi8pfiJZ0dqsUvKaBeA=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:42:19.683429 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-3198f902-8153-46aa-854a-b7cfed70ccf1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for project 3d04ba57221f42d684873d624dbfd283. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:42:19.687233 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-3198f902-8153-46aa-854a-b7cfed70ccf1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for user 5a0294ea40914bf290902307a787642d and project 3d04ba57221f42d684873d624dbfd283. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:42:19.795210 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3198f902-8153-46aa-854a-b7cfed70ccf1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.131602 Sep 06 04:42:19.796759 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 351/681] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Sep 6 04:42:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:42:22.302778 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1356418995", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c394cea-216c-4a1f-9277-2bb67bf6a21b"}], "security_groups": [{"name": "tempest-securitygroup--1865283125"}], "key_name": "tempest-keypair-1240146963", "user_data": "}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:42:22.412174 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] validate_networks() for [('4c394cea-216c-4a1f-9277-2bb67bf6a21b', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:42:22.863524 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:42:22.863950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:42:22.864422 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:42:22.864831 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:42:22.865243 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:42:22.874053 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:22.874532 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:22.874962 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:22.875681 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:22.876133 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:22.876553 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:22.893474 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for project 3d04ba57221f42d684873d624dbfd283. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:42:22.897490 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for user 5a0294ea40914bf290902307a787642d and project 3d04ba57221f42d684873d624dbfd283. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:42:22.909239 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:42:22.911530 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:42:23.050122 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-24035a54-e843-4400-a6fb-c6980a70de45 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.752926 Sep 06 04:42:23.050772 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 331/682] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:42:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:42:23.062378 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bc8a341b-4ef1-4242-8c5b-53cf723517fd tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:23.062983 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bc8a341b-4ef1-4242-8c5b-53cf723517fd tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:23.123441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bc8a341b-4ef1-4242-8c5b-53cf723517fd tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:23.130365 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bc8a341b-4ef1-4242-8c5b-53cf723517fd tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1242 microversion: 2.1 time: 0.072373 Sep 06 04:42:23.130922 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 352/683] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:23 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:24.153737 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7b392865-7b2e-4698-8506-3a256b3eb0cf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:24.154338 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7b392865-7b2e-4698-8506-3a256b3eb0cf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:24.160399 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b392865-7b2e-4698-8506-3a256b3eb0cf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:24.160867 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b392865-7b2e-4698-8506-3a256b3eb0cf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:24.161291 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b392865-7b2e-4698-8506-3a256b3eb0cf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:24.162032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b392865-7b2e-4698-8506-3a256b3eb0cf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:24.162505 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b392865-7b2e-4698-8506-3a256b3eb0cf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:24.162915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b392865-7b2e-4698-8506-3a256b3eb0cf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:24.224763 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7b392865-7b2e-4698-8506-3a256b3eb0cf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:24.232716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7b392865-7b2e-4698-8506-3a256b3eb0cf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1246 microversion: 2.1 time: 0.083596 Sep 06 04:42:24.234757 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 332/684] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:24 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:25.256315 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-886afb57-e087-46d6-9fa0-633ab8f59d5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:25.256917 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-886afb57-e087-46d6-9fa0-633ab8f59d5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:25.263328 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-886afb57-e087-46d6-9fa0-633ab8f59d5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:25.263810 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-886afb57-e087-46d6-9fa0-633ab8f59d5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:25.264245 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-886afb57-e087-46d6-9fa0-633ab8f59d5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:25.264918 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-886afb57-e087-46d6-9fa0-633ab8f59d5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:25.265391 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-886afb57-e087-46d6-9fa0-633ab8f59d5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:25.265810 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-886afb57-e087-46d6-9fa0-633ab8f59d5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:25.325206 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-886afb57-e087-46d6-9fa0-633ab8f59d5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:25.333544 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-886afb57-e087-46d6-9fa0-633ab8f59d5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1238 microversion: 2.1 time: 0.081108 Sep 06 04:42:25.334103 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 353/685] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:25 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:26.358728 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7123ea56-e775-4bba-9a1b-cd976a61a6cc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:26.359334 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7123ea56-e775-4bba-9a1b-cd976a61a6cc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:26.366515 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7123ea56-e775-4bba-9a1b-cd976a61a6cc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:26.367001 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7123ea56-e775-4bba-9a1b-cd976a61a6cc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:26.367436 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7123ea56-e775-4bba-9a1b-cd976a61a6cc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:26.368121 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7123ea56-e775-4bba-9a1b-cd976a61a6cc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:26.368573 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7123ea56-e775-4bba-9a1b-cd976a61a6cc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:26.368993 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7123ea56-e775-4bba-9a1b-cd976a61a6cc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:26.433247 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7123ea56-e775-4bba-9a1b-cd976a61a6cc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:26.442075 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7123ea56-e775-4bba-9a1b-cd976a61a6cc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1238 microversion: 2.1 time: 0.087128 Sep 06 04:42:26.442634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 333/686] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:26 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1238 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:27.464736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-45c722a5-53dd-4e90-8f39-f98e6e42eb0b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:27.465361 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-45c722a5-53dd-4e90-8f39-f98e6e42eb0b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:27.471776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-45c722a5-53dd-4e90-8f39-f98e6e42eb0b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:27.472254 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-45c722a5-53dd-4e90-8f39-f98e6e42eb0b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:27.472686 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-45c722a5-53dd-4e90-8f39-f98e6e42eb0b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:27.473429 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-45c722a5-53dd-4e90-8f39-f98e6e42eb0b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:27.473883 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-45c722a5-53dd-4e90-8f39-f98e6e42eb0b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:27.474305 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-45c722a5-53dd-4e90-8f39-f98e6e42eb0b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:27.535976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-45c722a5-53dd-4e90-8f39-f98e6e42eb0b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:27.543544 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-45c722a5-53dd-4e90-8f39-f98e6e42eb0b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1238 microversion: 2.1 time: 0.082713 Sep 06 04:42:27.544108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 354/687] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:27 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:27.574916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d6c449dd-188a-4b57-9201-255986d6f9fd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:27.575411 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d6c449dd-188a-4b57-9201-255986d6f9fd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:27.582942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6c449dd-188a-4b57-9201-255986d6f9fd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:27.583427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6c449dd-188a-4b57-9201-255986d6f9fd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:27.583856 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6c449dd-188a-4b57-9201-255986d6f9fd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:27.584532 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6c449dd-188a-4b57-9201-255986d6f9fd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:27.584979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6c449dd-188a-4b57-9201-255986d6f9fd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:27.585429 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d6c449dd-188a-4b57-9201-255986d6f9fd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:27.610172 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d6c449dd-188a-4b57-9201-255986d6f9fd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:42:27.733773 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:27.934262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d6c449dd-188a-4b57-9201-255986d6f9fd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 204 len: 0 microversion: 2.1 time: 0.362913 Sep 06 04:42:27.934850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 334/688] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:42:27 2022] DELETE /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:42:27.943942 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b590a0c6-6460-4f6f-892c-4bdbf4282db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:27.944585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b590a0c6-6460-4f6f-892c-4bdbf4282db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:27.950750 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b590a0c6-6460-4f6f-892c-4bdbf4282db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:27.951232 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b590a0c6-6460-4f6f-892c-4bdbf4282db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:27.951661 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b590a0c6-6460-4f6f-892c-4bdbf4282db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:27.952343 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b590a0c6-6460-4f6f-892c-4bdbf4282db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:27.952790 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b590a0c6-6460-4f6f-892c-4bdbf4282db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:27.953206 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b590a0c6-6460-4f6f-892c-4bdbf4282db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:28.083110 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b590a0c6-6460-4f6f-892c-4bdbf4282db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:28.091069 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b590a0c6-6460-4f6f-892c-4bdbf4282db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1577 microversion: 2.1 time: 0.151742 Sep 06 04:42:28.091667 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 355/689] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:27 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:28.567170 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6cfea1a8-f77c-4577-8ef1-78ee8a0da3d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:28.567856 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6cfea1a8-f77c-4577-8ef1-78ee8a0da3d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:28.573749 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6cfea1a8-f77c-4577-8ef1-78ee8a0da3d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:28.574226 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6cfea1a8-f77c-4577-8ef1-78ee8a0da3d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:28.574666 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6cfea1a8-f77c-4577-8ef1-78ee8a0da3d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:28.575359 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6cfea1a8-f77c-4577-8ef1-78ee8a0da3d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:28.575882 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6cfea1a8-f77c-4577-8ef1-78ee8a0da3d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:28.576214 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6cfea1a8-f77c-4577-8ef1-78ee8a0da3d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:28.639515 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6cfea1a8-f77c-4577-8ef1-78ee8a0da3d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:28.647727 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6cfea1a8-f77c-4577-8ef1-78ee8a0da3d5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1294 microversion: 2.1 time: 0.085066 Sep 06 04:42:28.648290 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 335/690] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:28 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:29.115861 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7235f81a-7153-400e-90d7-a7be02044f4d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:29.116691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7235f81a-7153-400e-90d7-a7be02044f4d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:29.123210 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7235f81a-7153-400e-90d7-a7be02044f4d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:29.123690 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7235f81a-7153-400e-90d7-a7be02044f4d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:29.124120 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7235f81a-7153-400e-90d7-a7be02044f4d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:29.124803 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7235f81a-7153-400e-90d7-a7be02044f4d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:29.125255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7235f81a-7153-400e-90d7-a7be02044f4d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:29.125718 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7235f81a-7153-400e-90d7-a7be02044f4d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:29.257425 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7235f81a-7153-400e-90d7-a7be02044f4d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:29.265104 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7235f81a-7153-400e-90d7-a7be02044f4d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1577 microversion: 2.1 time: 0.153806 Sep 06 04:42:29.265699 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 356/691] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:29 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:29.670982 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1e6a8110-72a1-40ed-b8e2-b8508cff86d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:29.671581 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1e6a8110-72a1-40ed-b8e2-b8508cff86d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:29.680758 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e6a8110-72a1-40ed-b8e2-b8508cff86d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:29.681519 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e6a8110-72a1-40ed-b8e2-b8508cff86d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:29.682165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e6a8110-72a1-40ed-b8e2-b8508cff86d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:29.683198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e6a8110-72a1-40ed-b8e2-b8508cff86d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:29.683880 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e6a8110-72a1-40ed-b8e2-b8508cff86d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:29.684511 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1e6a8110-72a1-40ed-b8e2-b8508cff86d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:29.747056 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1e6a8110-72a1-40ed-b8e2-b8508cff86d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:29.755173 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1e6a8110-72a1-40ed-b8e2-b8508cff86d8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1294 microversion: 2.1 time: 0.088135 Sep 06 04:42:29.755730 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 336/692] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:29 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1294 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:30.288695 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-75fbb83d-8c8e-4db5-9d8b-54a8d8934ca1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:30.289216 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-75fbb83d-8c8e-4db5-9d8b-54a8d8934ca1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:30.295729 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75fbb83d-8c8e-4db5-9d8b-54a8d8934ca1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:30.296246 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75fbb83d-8c8e-4db5-9d8b-54a8d8934ca1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:30.296683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75fbb83d-8c8e-4db5-9d8b-54a8d8934ca1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:30.297399 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75fbb83d-8c8e-4db5-9d8b-54a8d8934ca1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:30.297854 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75fbb83d-8c8e-4db5-9d8b-54a8d8934ca1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:30.298275 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75fbb83d-8c8e-4db5-9d8b-54a8d8934ca1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:30.447532 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-75fbb83d-8c8e-4db5-9d8b-54a8d8934ca1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:30.455711 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-75fbb83d-8c8e-4db5-9d8b-54a8d8934ca1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1577 microversion: 2.1 time: 0.170792 Sep 06 04:42:30.456280 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 357/693] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:30 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:30.779259 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a9fd7698-c4a8-49ea-8275-7e4309969192 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:30.780457 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a9fd7698-c4a8-49ea-8275-7e4309969192 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:30.788626 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9fd7698-c4a8-49ea-8275-7e4309969192 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:30.789113 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9fd7698-c4a8-49ea-8275-7e4309969192 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:30.791392 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9fd7698-c4a8-49ea-8275-7e4309969192 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:30.791392 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9fd7698-c4a8-49ea-8275-7e4309969192 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:30.791392 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9fd7698-c4a8-49ea-8275-7e4309969192 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:30.791392 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9fd7698-c4a8-49ea-8275-7e4309969192 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:30.870050 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a9fd7698-c4a8-49ea-8275-7e4309969192 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:30.878050 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a9fd7698-c4a8-49ea-8275-7e4309969192 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1302 microversion: 2.1 time: 0.103137 Sep 06 04:42:30.878550 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 337/694] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:30 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1302 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:31.321872 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-d5143ce7-7ed0-4659-b658-e2c322368c90 req-0f347ff6-48b5-4613-a5e4-978cc9aa5c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aacebb8e-d1b3-4ca8-87ac-3eb37184f747", "name": "network-vif-deleted", "tag": "50196b94-245d-464f-b64e-df03a8b65048"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:42:31.334670 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-d5143ce7-7ed0-4659-b658-e2c322368c90 req-0f347ff6-48b5-4613-a5e4-978cc9aa5c8c service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:31.334670 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-d5143ce7-7ed0-4659-b658-e2c322368c90 req-0f347ff6-48b5-4613-a5e4-978cc9aa5c8c service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:31.335005 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-d5143ce7-7ed0-4659-b658-e2c322368c90 req-0f347ff6-48b5-4613-a5e4-978cc9aa5c8c service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:31.339074 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:31.347127 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-d5143ce7-7ed0-4659-b658-e2c322368c90 req-0f347ff6-48b5-4613-a5e4-978cc9aa5c8c service nova] Creating event network-vif-deleted:50196b94-245d-464f-b64e-df03a8b65048 for instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 on hv-cinder-85600 Sep 06 04:42:31.353035 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-d5143ce7-7ed0-4659-b658-e2c322368c90 req-0f347ff6-48b5-4613-a5e4-978cc9aa5c8c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041713 Sep 06 04:42:31.354503 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 358/695] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:42:31.484041 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f7daa233-66d6-4b31-aaa9-f72fdf240b54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:31.484041 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f7daa233-66d6-4b31-aaa9-f72fdf240b54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:31.489773 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7daa233-66d6-4b31-aaa9-f72fdf240b54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:31.490519 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7daa233-66d6-4b31-aaa9-f72fdf240b54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:31.491357 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7daa233-66d6-4b31-aaa9-f72fdf240b54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:31.492384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7daa233-66d6-4b31-aaa9-f72fdf240b54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:31.493038 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7daa233-66d6-4b31-aaa9-f72fdf240b54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:31.493704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f7daa233-66d6-4b31-aaa9-f72fdf240b54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:31.593101 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f7daa233-66d6-4b31-aaa9-f72fdf240b54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:31.601410 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f7daa233-66d6-4b31-aaa9-f72fdf240b54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1509 microversion: 2.1 time: 0.124917 Sep 06 04:42:31.602005 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 338/696] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:31 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1509 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:31.904136 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2c5ef669-6cf1-4e11-bc0f-8b7c6bc9c784 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:31.908028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2c5ef669-6cf1-4e11-bc0f-8b7c6bc9c784 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:31.922650 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c5ef669-6cf1-4e11-bc0f-8b7c6bc9c784 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:31.931641 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c5ef669-6cf1-4e11-bc0f-8b7c6bc9c784 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:31.932103 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c5ef669-6cf1-4e11-bc0f-8b7c6bc9c784 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:31.932841 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c5ef669-6cf1-4e11-bc0f-8b7c6bc9c784 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:31.933296 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c5ef669-6cf1-4e11-bc0f-8b7c6bc9c784 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:31.933914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2c5ef669-6cf1-4e11-bc0f-8b7c6bc9c784 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:32.172603 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2c5ef669-6cf1-4e11-bc0f-8b7c6bc9c784 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:32.188669 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2c5ef669-6cf1-4e11-bc0f-8b7c6bc9c784 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1368 microversion: 2.1 time: 0.289228 Sep 06 04:42:32.192119 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 359/697] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:31 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1368 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:32.626965 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6e6146c3-107c-44c7-8faf-7a25c600faba tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:32.628358 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6e6146c3-107c-44c7-8faf-7a25c600faba tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:32.630858 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:32.637239 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e6146c3-107c-44c7-8faf-7a25c600faba tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:32.637940 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e6146c3-107c-44c7-8faf-7a25c600faba tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:32.638673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e6146c3-107c-44c7-8faf-7a25c600faba tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:32.639984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e6146c3-107c-44c7-8faf-7a25c600faba tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:32.640596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e6146c3-107c-44c7-8faf-7a25c600faba tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:32.641217 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e6146c3-107c-44c7-8faf-7a25c600faba tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:32.678259 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e6146c3-107c-44c7-8faf-7a25c600faba tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:32.678777 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e6146c3-107c-44c7-8faf-7a25c600faba tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:32.679156 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6e6146c3-107c-44c7-8faf-7a25c600faba tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:32.680165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-6e6146c3-107c-44c7-8faf-7a25c600faba tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lazy-loading 'fault' on Instance uuid aacebb8e-d1b3-4ca8-87ac-3eb37184f747 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:42:32.732717 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6e6146c3-107c-44c7-8faf-7a25c600faba tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:32.744983 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6e6146c3-107c-44c7-8faf-7a25c600faba tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1229 microversion: 2.1 time: 0.121496 Sep 06 04:42:32.746447 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 339/698] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:32 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1229 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:32.975340 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-23be2b2c-161b-4571-9544-ff0fbc8e57c9 req-63ddd047-30ff-4783-8f23-17b389e777e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6059864b-289a-4aa6-85b9-9041ca7e9d2d", "tag": "e194fb45-529b-4235-84c0-becbe4954bd3"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:42:32.981062 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:32.986590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-23be2b2c-161b-4571-9544-ff0fbc8e57c9 req-63ddd047-30ff-4783-8f23-17b389e777e0 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:32.987325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-23be2b2c-161b-4571-9544-ff0fbc8e57c9 req-63ddd047-30ff-4783-8f23-17b389e777e0 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:32.987805 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-23be2b2c-161b-4571-9544-ff0fbc8e57c9 req-63ddd047-30ff-4783-8f23-17b389e777e0 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:33.002553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-23be2b2c-161b-4571-9544-ff0fbc8e57c9 req-63ddd047-30ff-4783-8f23-17b389e777e0 service nova] Creating event network-changed:e194fb45-529b-4235-84c0-becbe4954bd3 for instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d on hv-cinder-85600 Sep 06 04:42:33.008422 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-23be2b2c-161b-4571-9544-ff0fbc8e57c9 req-63ddd047-30ff-4783-8f23-17b389e777e0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037462 Sep 06 04:42:33.009446 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 360/699] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:42:33.212870 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f3bcfe44-c699-4358-92da-4b68ba951053 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:33.213702 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f3bcfe44-c699-4358-92da-4b68ba951053 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:33.215842 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:33.216499 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:33.222770 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3bcfe44-c699-4358-92da-4b68ba951053 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:33.223249 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3bcfe44-c699-4358-92da-4b68ba951053 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:33.224035 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3bcfe44-c699-4358-92da-4b68ba951053 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:33.224782 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3bcfe44-c699-4358-92da-4b68ba951053 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:33.225227 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3bcfe44-c699-4358-92da-4b68ba951053 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:33.225677 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f3bcfe44-c699-4358-92da-4b68ba951053 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:33.376483 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f3bcfe44-c699-4358-92da-4b68ba951053 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:33.389910 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f3bcfe44-c699-4358-92da-4b68ba951053 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1368 microversion: 2.1 time: 0.180970 Sep 06 04:42:33.390487 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 340/700] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:33 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:33.767264 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:33.774288 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-59ae3e21-0618-4061-8bec-621dd0056c46 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:33.775272 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-59ae3e21-0618-4061-8bec-621dd0056c46 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:33.784315 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-59ae3e21-0618-4061-8bec-621dd0056c46 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:33.785017 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-59ae3e21-0618-4061-8bec-621dd0056c46 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:33.785593 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-59ae3e21-0618-4061-8bec-621dd0056c46 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:33.786375 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-59ae3e21-0618-4061-8bec-621dd0056c46 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:33.786905 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-59ae3e21-0618-4061-8bec-621dd0056c46 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:33.787406 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-59ae3e21-0618-4061-8bec-621dd0056c46 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:33.820915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-59ae3e21-0618-4061-8bec-621dd0056c46 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:33.821496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-59ae3e21-0618-4061-8bec-621dd0056c46 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:33.821896 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-59ae3e21-0618-4061-8bec-621dd0056c46 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:33.822285 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-59ae3e21-0618-4061-8bec-621dd0056c46 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lazy-loading 'fault' on Instance uuid aacebb8e-d1b3-4ca8-87ac-3eb37184f747 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:42:33.906982 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-59ae3e21-0618-4061-8bec-621dd0056c46 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:33.915787 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-59ae3e21-0618-4061-8bec-621dd0056c46 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 200 len: 1229 microversion: 2.1 time: 0.149361 Sep 06 04:42:33.925724 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 361/701] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:33 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 1229 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:34.418288 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bfc7d7ec-5a1e-4b67-894a-542d8964726d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:34.418937 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bfc7d7ec-5a1e-4b67-894a-542d8964726d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:34.425976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfc7d7ec-5a1e-4b67-894a-542d8964726d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:34.426453 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfc7d7ec-5a1e-4b67-894a-542d8964726d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:34.426884 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfc7d7ec-5a1e-4b67-894a-542d8964726d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:34.427563 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfc7d7ec-5a1e-4b67-894a-542d8964726d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:34.428015 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfc7d7ec-5a1e-4b67-894a-542d8964726d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:34.428434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bfc7d7ec-5a1e-4b67-894a-542d8964726d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:34.615074 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bfc7d7ec-5a1e-4b67-894a-542d8964726d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:34.632014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bfc7d7ec-5a1e-4b67-894a-542d8964726d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1368 microversion: 2.1 time: 0.216747 Sep 06 04:42:34.632014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 341/702] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:34 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:42:34.938332 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2669c7b4-63e8-4b43-9c73-298fd063dd19 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:34.938926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2669c7b4-63e8-4b43-9c73-298fd063dd19 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:34.946831 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2669c7b4-63e8-4b43-9c73-298fd063dd19 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:34.950281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2669c7b4-63e8-4b43-9c73-298fd063dd19 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:34.950281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2669c7b4-63e8-4b43-9c73-298fd063dd19 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:34.950281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2669c7b4-63e8-4b43-9c73-298fd063dd19 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:34.950281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2669c7b4-63e8-4b43-9c73-298fd063dd19 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:34.950633 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2669c7b4-63e8-4b43-9c73-298fd063dd19 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:34.963184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-2669c7b4-63e8-4b43-9c73-298fd063dd19 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] HTTP exception thrown: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2669c7b4-63e8-4b43-9c73-298fd063dd19 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Request method failure captured: Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 HTTP/1.1 Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs6XEjQEyM6nKq0ZriqSzERpRXfI9RecNHUJ07KTEpheMAPY4j1BhEyJ51sogfhmDB4NQr9DfiOQJDUhCy_PMs6jFbeLsRZSGC0Q5pjs-7hswbX4fXwXOIB6YPPmB6qqbfxN87ZX34i8V_WRilq7J0oc1TJzcbujq1FRoxGCS_iOIMk Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 375efd2890fc4b71af13439813f00ab0 Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-TestVolumeBootPattern-1515166800 Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:42:34.964789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:42:34.966178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/375efd2890fc4b71af13439813f00ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/375efd2890fc4b71af13439813f00ab0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_375efd2890fc4b71af13439813f00ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/375efd2890fc4b71af13439813f00ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:42:34.966178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-TestVolumeBootPattern-1515166800 Sep 06 04:42:34.966178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 375efd2890fc4b71af13439813f00ab0 Sep 06 04:42:34.966178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-TestVolumeBootPattern-1515166800 Sep 06 04:42:34.966178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-TestVolumeBootPattern-1515166800-project Sep 06 04:42:34.966178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:42:34.966178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:42:34.966178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 4b6c761af9c5457ea1e481ce400aded8 Sep 06 04:42:34.966178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-TestVolumeBootPattern-1515166800-project Sep 06 04:42:34.966178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:42:34.966178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. Sep 06 04:42:34.966178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': 'aacebb8e-d1b3-4ca8-87ac-3eb37184f747'} Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:42:34.966976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. Sep 06 04:42:34.968505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:42:34.969996 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2669c7b4-63e8-4b43-9c73-298fd063dd19 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Returning 404 to user: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:42:34.969996 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2669c7b4-63e8-4b43-9c73-298fd063dd19 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 404 len: 111 microversion: 2.1 time: 0.031782 Sep 06 04:42:34.969996 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 362/703] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:34 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:42:35.071966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-778600964", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-153806682", "security_groups": [{"name": "tempest-secgroup-smoke-1357749998"}], "block_device_mapping_v2": [{"uuid": "019e728a-be1a-45d3-a8be-0e03476714e4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "713bea32-eeee-4105-a352-3326771fb659"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:42:35.193339 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] validate_networks() for [('713bea32-eeee-4105-a352-3326771fb659', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:42:35.563324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:42:35.564397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:42:35.565892 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:42:35.566515 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:42:35.567299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:42:35.577608 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:35.578317 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:35.578990 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:35.579899 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:35.581288 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:35.582246 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:35.601613 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Getting quotas for project 375efd2890fc4b71af13439813f00ab0. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:42:35.605660 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Getting quotas for user 4b6c761af9c5457ea1e481ce400aded8 and project 375efd2890fc4b71af13439813f00ab0. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:42:35.664468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6ba530bf-2133-4eba-849a-8f148636b076 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:35.667056 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6ba530bf-2133-4eba-849a-8f148636b076 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:35.670543 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:42:35.673159 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='019e728a-be1a-45d3-a8be-0e03476714e4',volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:42:35.682819 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6ba530bf-2133-4eba-849a-8f148636b076 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:35.689036 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6ba530bf-2133-4eba-849a-8f148636b076 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:35.689036 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6ba530bf-2133-4eba-849a-8f148636b076 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:35.689036 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6ba530bf-2133-4eba-849a-8f148636b076 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:35.689036 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6ba530bf-2133-4eba-849a-8f148636b076 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:35.689415 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6ba530bf-2133-4eba-849a-8f148636b076 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:35.870473 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6ba530bf-2133-4eba-849a-8f148636b076 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:35.878957 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6ba530bf-2133-4eba-849a-8f148636b076 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1368 microversion: 2.1 time: 0.226629 Sep 06 04:42:35.880013 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 363/704] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:35 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:36.175553 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8b24cadb-9c0b-4087-b7ef-f28f8ef242ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.107104 Sep 06 04:42:36.180447 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 342/705] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:42:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:42:36.201655 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f8ad45a0-f503-4218-96a5-b6b5c759310b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:36.201655 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f8ad45a0-f503-4218-96a5-b6b5c759310b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:36.356343 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f8ad45a0-f503-4218-96a5-b6b5c759310b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:36.369085 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f8ad45a0-f503-4218-96a5-b6b5c759310b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1093 microversion: 2.1 time: 0.182633 Sep 06 04:42:36.370528 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 364/706] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:36 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1093 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:36.903240 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6f3506b4-2af3-4a22-ad42-d2bbea78ac60 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:36.905733 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6f3506b4-2af3-4a22-ad42-d2bbea78ac60 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:36.914004 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f3506b4-2af3-4a22-ad42-d2bbea78ac60 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:36.914498 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f3506b4-2af3-4a22-ad42-d2bbea78ac60 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:36.915374 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f3506b4-2af3-4a22-ad42-d2bbea78ac60 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:36.915802 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f3506b4-2af3-4a22-ad42-d2bbea78ac60 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:36.916258 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f3506b4-2af3-4a22-ad42-d2bbea78ac60 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:36.916859 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f3506b4-2af3-4a22-ad42-d2bbea78ac60 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:37.151923 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6f3506b4-2af3-4a22-ad42-d2bbea78ac60 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:37.163150 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6f3506b4-2af3-4a22-ad42-d2bbea78ac60 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1368 microversion: 2.1 time: 0.263921 Sep 06 04:42:37.178165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 343/707] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:36 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1368 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:37.395030 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-14d21016-deab-4375-9f55-d825688456e0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:37.395696 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-14d21016-deab-4375-9f55-d825688456e0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:37.402985 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14d21016-deab-4375-9f55-d825688456e0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:37.403793 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14d21016-deab-4375-9f55-d825688456e0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:37.404226 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14d21016-deab-4375-9f55-d825688456e0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:37.404928 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14d21016-deab-4375-9f55-d825688456e0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:37.405405 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14d21016-deab-4375-9f55-d825688456e0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:37.405860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-14d21016-deab-4375-9f55-d825688456e0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:37.483358 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d509e3b1-9a13-4db7-ab12-be4901806332 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:37.483867 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d509e3b1-9a13-4db7-ab12-be4901806332 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:37.485071 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-14d21016-deab-4375-9f55-d825688456e0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:37.490951 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d509e3b1-9a13-4db7-ab12-be4901806332 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:37.492266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d509e3b1-9a13-4db7-ab12-be4901806332 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:37.492266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d509e3b1-9a13-4db7-ab12-be4901806332 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:37.492620 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d509e3b1-9a13-4db7-ab12-be4901806332 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:37.493269 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d509e3b1-9a13-4db7-ab12-be4901806332 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:37.493884 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d509e3b1-9a13-4db7-ab12-be4901806332 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:37.495464 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-14d21016-deab-4375-9f55-d825688456e0 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1143 microversion: 2.1 time: 0.105972 Sep 06 04:42:37.496779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 365/708] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:37 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1143 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:37.535368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d509e3b1-9a13-4db7-ab12-be4901806332 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/os-volume_attachments/9a86fa61-7fa6-4c3e-acd6-4ad937cd7b7e" status: 200 len: 194 microversion: 2.20 time: 0.055588 Sep 06 04:42:37.536676 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 344/709] 10.222.0.30 () {60 vars in 1454 bytes} [Tue Sep 6 04:42:37 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/os-volume_attachments/9a86fa61-7fa6-4c3e-acd6-4ad937cd7b7e => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 06 04:42:37.647117 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-aff2fade-d398-49a4-a04a-9911cc406a31 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:37.647715 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-aff2fade-d398-49a4-a04a-9911cc406a31 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:37.655312 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aff2fade-d398-49a4-a04a-9911cc406a31 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:37.655800 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aff2fade-d398-49a4-a04a-9911cc406a31 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:37.656243 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aff2fade-d398-49a4-a04a-9911cc406a31 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:37.657080 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aff2fade-d398-49a4-a04a-9911cc406a31 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:37.657536 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aff2fade-d398-49a4-a04a-9911cc406a31 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:37.657964 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aff2fade-d398-49a4-a04a-9911cc406a31 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:37.771893 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-aff2fade-d398-49a4-a04a-9911cc406a31 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lazy-loading 'services' on Instance uuid 53238a8f-2601-4952-acd2-4dcb02761c12 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:42:38.028302 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-aff2fade-d398-49a4-a04a-9911cc406a31 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "DELETE /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/os-volume_attachments/9a86fa61-7fa6-4c3e-acd6-4ad937cd7b7e" status: 202 len: 0 microversion: 2.20 time: 0.387488 Sep 06 04:42:38.029293 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 366/710] 10.222.0.30 () {60 vars in 1457 bytes} [Tue Sep 6 04:42:37 2022] DELETE /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/os-volume_attachments/9a86fa61-7fa6-4c3e-acd6-4ad937cd7b7e => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:42:38.038976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-57bbedfb-f7fc-434a-8c29-06bb62e75aff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:38.042676 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-57bbedfb-f7fc-434a-8c29-06bb62e75aff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:38.051763 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-57bbedfb-f7fc-434a-8c29-06bb62e75aff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:38.052576 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-57bbedfb-f7fc-434a-8c29-06bb62e75aff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:38.058160 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-57bbedfb-f7fc-434a-8c29-06bb62e75aff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:38.058160 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-57bbedfb-f7fc-434a-8c29-06bb62e75aff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:38.058160 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-57bbedfb-f7fc-434a-8c29-06bb62e75aff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:38.058160 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-57bbedfb-f7fc-434a-8c29-06bb62e75aff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:38.096334 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-57bbedfb-f7fc-434a-8c29-06bb62e75aff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062138 Sep 06 04:42:38.098708 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 345/711] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Sep 6 04:42:38 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:42:38.189253 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2255eb69-78e6-4326-92a8-466105bea521 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:38.191300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2255eb69-78e6-4326-92a8-466105bea521 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:38.199171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2255eb69-78e6-4326-92a8-466105bea521 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:38.201247 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2255eb69-78e6-4326-92a8-466105bea521 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:38.201247 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2255eb69-78e6-4326-92a8-466105bea521 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:38.212750 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2255eb69-78e6-4326-92a8-466105bea521 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:38.214711 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2255eb69-78e6-4326-92a8-466105bea521 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:38.216472 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2255eb69-78e6-4326-92a8-466105bea521 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:38.368306 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2255eb69-78e6-4326-92a8-466105bea521 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:38.378253 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2255eb69-78e6-4326-92a8-466105bea521 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1368 microversion: 2.1 time: 0.193495 Sep 06 04:42:38.385359 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 367/712] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:38 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1368 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:38.522562 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0df6674b-67c1-4d51-8886-41d7e36971d7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:38.523164 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0df6674b-67c1-4d51-8886-41d7e36971d7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:38.529333 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0df6674b-67c1-4d51-8886-41d7e36971d7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:38.529821 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0df6674b-67c1-4d51-8886-41d7e36971d7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:38.530254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0df6674b-67c1-4d51-8886-41d7e36971d7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:38.531034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0df6674b-67c1-4d51-8886-41d7e36971d7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:38.531481 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0df6674b-67c1-4d51-8886-41d7e36971d7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:38.531901 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0df6674b-67c1-4d51-8886-41d7e36971d7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:38.598280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0df6674b-67c1-4d51-8886-41d7e36971d7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:38.613777 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0df6674b-67c1-4d51-8886-41d7e36971d7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1191 microversion: 2.1 time: 0.093615 Sep 06 04:42:38.613777 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 346/713] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:38 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:39.110039 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fd732de1-8050-443f-acc3-2b7e40f4fdca tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:39.114380 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fd732de1-8050-443f-acc3-2b7e40f4fdca tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:39.125699 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd732de1-8050-443f-acc3-2b7e40f4fdca tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:39.126271 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd732de1-8050-443f-acc3-2b7e40f4fdca tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:39.129423 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd732de1-8050-443f-acc3-2b7e40f4fdca tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:39.131057 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd732de1-8050-443f-acc3-2b7e40f4fdca tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:39.131730 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd732de1-8050-443f-acc3-2b7e40f4fdca tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:39.132334 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd732de1-8050-443f-acc3-2b7e40f4fdca tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:39.168889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fd732de1-8050-443f-acc3-2b7e40f4fdca tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062638 Sep 06 04:42:39.175920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 368/714] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Sep 6 04:42:39 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:42:39.411772 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-be93995b-d254-4a0d-9881-39b8898eb5dc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:39.412385 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-be93995b-d254-4a0d-9881-39b8898eb5dc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:39.421166 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be93995b-d254-4a0d-9881-39b8898eb5dc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:39.421684 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be93995b-d254-4a0d-9881-39b8898eb5dc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:39.422121 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be93995b-d254-4a0d-9881-39b8898eb5dc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:39.422829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be93995b-d254-4a0d-9881-39b8898eb5dc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:39.423280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be93995b-d254-4a0d-9881-39b8898eb5dc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:39.423703 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-be93995b-d254-4a0d-9881-39b8898eb5dc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:39.636238 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1f50a121-78e0-4202-9f41-c1a9000166b6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:39.637171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1f50a121-78e0-4202-9f41-c1a9000166b6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:39.657685 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f50a121-78e0-4202-9f41-c1a9000166b6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:39.658675 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f50a121-78e0-4202-9f41-c1a9000166b6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:39.660895 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f50a121-78e0-4202-9f41-c1a9000166b6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:39.662084 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f50a121-78e0-4202-9f41-c1a9000166b6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:39.665709 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f50a121-78e0-4202-9f41-c1a9000166b6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:39.666398 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f50a121-78e0-4202-9f41-c1a9000166b6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:39.789794 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1f50a121-78e0-4202-9f41-c1a9000166b6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:39.801364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1f50a121-78e0-4202-9f41-c1a9000166b6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1199 microversion: 2.1 time: 0.168267 Sep 06 04:42:39.802825 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 369/715] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:39 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1199 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:42:39.941226 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-be93995b-d254-4a0d-9881-39b8898eb5dc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:39.950943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-be93995b-d254-4a0d-9881-39b8898eb5dc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1368 microversion: 2.1 time: 0.545130 Sep 06 04:42:39.954067 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 347/716] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:39 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1368 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:40.181843 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-71c07a8b-bac8-4e28-807d-dc8ab59f39f7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:40.187784 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-71c07a8b-bac8-4e28-807d-dc8ab59f39f7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:40.198321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71c07a8b-bac8-4e28-807d-dc8ab59f39f7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:40.199038 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71c07a8b-bac8-4e28-807d-dc8ab59f39f7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:40.199673 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71c07a8b-bac8-4e28-807d-dc8ab59f39f7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:40.200642 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71c07a8b-bac8-4e28-807d-dc8ab59f39f7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:40.201089 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71c07a8b-bac8-4e28-807d-dc8ab59f39f7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:40.201755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-71c07a8b-bac8-4e28-807d-dc8ab59f39f7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:40.236448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-71c07a8b-bac8-4e28-807d-dc8ab59f39f7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.058488 Sep 06 04:42:40.240435 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 370/717] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Sep 6 04:42:40 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:40.325421 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-53643c63-693c-4418-89f6-b6166319934d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:40.325983 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-53643c63-693c-4418-89f6-b6166319934d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:40.332989 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-53643c63-693c-4418-89f6-b6166319934d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:40.333990 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-53643c63-693c-4418-89f6-b6166319934d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:40.334660 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-53643c63-693c-4418-89f6-b6166319934d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:40.335647 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-53643c63-693c-4418-89f6-b6166319934d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:40.336170 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-53643c63-693c-4418-89f6-b6166319934d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:40.336657 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-53643c63-693c-4418-89f6-b6166319934d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:40.372736 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-53643c63-693c-4418-89f6-b6166319934d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:42:40.699868 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-53643c63-693c-4418-89f6-b6166319934d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "DELETE /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 204 len: 0 microversion: 2.20 time: 0.379888 Sep 06 04:42:40.700652 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 348/718] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Sep 6 04:42:40 2022] DELETE /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 04:42:40.711237 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c5014b1a-f4d2-4f2f-82ce-af6bce69b32f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:40.712066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c5014b1a-f4d2-4f2f-82ce-af6bce69b32f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:40.717989 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5014b1a-f4d2-4f2f-82ce-af6bce69b32f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:40.718662 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5014b1a-f4d2-4f2f-82ce-af6bce69b32f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:40.719261 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5014b1a-f4d2-4f2f-82ce-af6bce69b32f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:40.720389 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5014b1a-f4d2-4f2f-82ce-af6bce69b32f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:40.721476 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5014b1a-f4d2-4f2f-82ce-af6bce69b32f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:40.721906 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c5014b1a-f4d2-4f2f-82ce-af6bce69b32f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:40.829566 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b7f2c558-7785-4608-91e9-3c347905bf63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:40.832281 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b7f2c558-7785-4608-91e9-3c347905bf63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:40.844111 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7f2c558-7785-4608-91e9-3c347905bf63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:40.845195 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7f2c558-7785-4608-91e9-3c347905bf63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:40.846890 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7f2c558-7785-4608-91e9-3c347905bf63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:40.848087 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7f2c558-7785-4608-91e9-3c347905bf63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:40.848819 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7f2c558-7785-4608-91e9-3c347905bf63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:40.851200 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b7f2c558-7785-4608-91e9-3c347905bf63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:40.904459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c5014b1a-f4d2-4f2f-82ce-af6bce69b32f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:40.910618 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c5014b1a-f4d2-4f2f-82ce-af6bce69b32f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:40.912273 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c5014b1a-f4d2-4f2f-82ce-af6bce69b32f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:40.913481 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c5014b1a-f4d2-4f2f-82ce-af6bce69b32f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.206215 Sep 06 04:42:40.914211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 371/719] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:42:40 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:42:40.976032 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-698575e2-9167-4ea2-8931-0c58cdac0fb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:40.976677 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-698575e2-9167-4ea2-8931-0c58cdac0fb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:40.983826 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-698575e2-9167-4ea2-8931-0c58cdac0fb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:40.989752 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-698575e2-9167-4ea2-8931-0c58cdac0fb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:40.990277 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-698575e2-9167-4ea2-8931-0c58cdac0fb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:40.991017 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-698575e2-9167-4ea2-8931-0c58cdac0fb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:40.991486 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-698575e2-9167-4ea2-8931-0c58cdac0fb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:40.993551 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-698575e2-9167-4ea2-8931-0c58cdac0fb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:41.084719 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b7f2c558-7785-4608-91e9-3c347905bf63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:41.087377 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:41.092427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b7f2c558-7785-4608-91e9-3c347905bf63 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1277 microversion: 2.1 time: 0.268038 Sep 06 04:42:41.092998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 349/720] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:40 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1277 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:42:41.154652 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-698575e2-9167-4ea2-8931-0c58cdac0fb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:41.165586 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-698575e2-9167-4ea2-8931-0c58cdac0fb1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1368 microversion: 2.1 time: 0.195520 Sep 06 04:42:41.166603 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 372/721] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:40 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:42:41.643960 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-2ee4469d-14a0-4333-9af0-4977129a038a req-4bf4c96c-5a97-4170-aa7c-680f2a9865b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6059864b-289a-4aa6-85b9-9041ca7e9d2d", "name": "network-vif-plugged", "status": "completed", "tag": "e194fb45-529b-4235-84c0-becbe4954bd3"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:42:41.654859 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2ee4469d-14a0-4333-9af0-4977129a038a req-4bf4c96c-5a97-4170-aa7c-680f2a9865b7 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:41.655456 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2ee4469d-14a0-4333-9af0-4977129a038a req-4bf4c96c-5a97-4170-aa7c-680f2a9865b7 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:41.656027 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2ee4469d-14a0-4333-9af0-4977129a038a req-4bf4c96c-5a97-4170-aa7c-680f2a9865b7 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:41.670607 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-2ee4469d-14a0-4333-9af0-4977129a038a req-4bf4c96c-5a97-4170-aa7c-680f2a9865b7 service nova] Creating event network-vif-plugged:e194fb45-529b-4235-84c0-becbe4954bd3 for instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d on hv-cinder-85600 Sep 06 04:42:41.676116 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-2ee4469d-14a0-4333-9af0-4977129a038a req-4bf4c96c-5a97-4170-aa7c-680f2a9865b7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.267754 Sep 06 04:42:41.677458 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 350/722] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:42:41.948348 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2459064e-1697-44c8-afc5-b76f9846490f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:41.949666 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2459064e-1697-44c8-afc5-b76f9846490f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:41.956836 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2459064e-1697-44c8-afc5-b76f9846490f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:41.957426 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2459064e-1697-44c8-afc5-b76f9846490f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:41.957931 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2459064e-1697-44c8-afc5-b76f9846490f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:41.958684 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2459064e-1697-44c8-afc5-b76f9846490f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:41.959611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2459064e-1697-44c8-afc5-b76f9846490f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:41.960094 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2459064e-1697-44c8-afc5-b76f9846490f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:42.112882 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2459064e-1697-44c8-afc5-b76f9846490f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:42.125868 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d01bdc1e-bb9a-4142-b694-ebb4927d2d10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:42.126697 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2459064e-1697-44c8-afc5-b76f9846490f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:42.128250 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d01bdc1e-bb9a-4142-b694-ebb4927d2d10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:42.130777 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2459064e-1697-44c8-afc5-b76f9846490f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:42.132411 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2459064e-1697-44c8-afc5-b76f9846490f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.188492 Sep 06 04:42:42.133598 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 373/723] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:42:41 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:42:42.157021 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d01bdc1e-bb9a-4142-b694-ebb4927d2d10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:42.157021 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d01bdc1e-bb9a-4142-b694-ebb4927d2d10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:42.157021 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d01bdc1e-bb9a-4142-b694-ebb4927d2d10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:42.157021 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d01bdc1e-bb9a-4142-b694-ebb4927d2d10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:42.157627 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d01bdc1e-bb9a-4142-b694-ebb4927d2d10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:42.157627 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d01bdc1e-bb9a-4142-b694-ebb4927d2d10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:42.193080 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-77308b32-9cd9-4bd3-bb9d-498788eff177 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:42.193993 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-77308b32-9cd9-4bd3-bb9d-498788eff177 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:42.204862 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-77308b32-9cd9-4bd3-bb9d-498788eff177 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:42.204862 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-77308b32-9cd9-4bd3-bb9d-498788eff177 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:42.204862 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-77308b32-9cd9-4bd3-bb9d-498788eff177 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:42.204862 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-77308b32-9cd9-4bd3-bb9d-498788eff177 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:42.205599 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-77308b32-9cd9-4bd3-bb9d-498788eff177 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:42.205599 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-77308b32-9cd9-4bd3-bb9d-498788eff177 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:42.366757 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-77308b32-9cd9-4bd3-bb9d-498788eff177 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:42.375241 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-77308b32-9cd9-4bd3-bb9d-498788eff177 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1368 microversion: 2.1 time: 0.187008 Sep 06 04:42:42.375810 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 374/724] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:42 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:42:42.548116 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d01bdc1e-bb9a-4142-b694-ebb4927d2d10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:42.558560 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d01bdc1e-bb9a-4142-b694-ebb4927d2d10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1277 microversion: 2.1 time: 0.444951 Sep 06 04:42:42.560151 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 351/725] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:42 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1277 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:43.162527 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1da6dd8c-4edd-42c5-967a-dafbc62232d4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:43.163762 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1da6dd8c-4edd-42c5-967a-dafbc62232d4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:43.170296 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1da6dd8c-4edd-42c5-967a-dafbc62232d4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:43.170780 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1da6dd8c-4edd-42c5-967a-dafbc62232d4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:43.171390 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1da6dd8c-4edd-42c5-967a-dafbc62232d4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:43.172080 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1da6dd8c-4edd-42c5-967a-dafbc62232d4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:43.172524 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1da6dd8c-4edd-42c5-967a-dafbc62232d4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:43.173115 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1da6dd8c-4edd-42c5-967a-dafbc62232d4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:43.206336 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-80b8076f-9700-435c-a3b1-d6cb91349f4f req-72f67a91-3f51-476d-a43f-e22daffa5089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65eefee7-f977-45ba-92a9-d0a97facdad7", "tag": "8a88b191-41e1-4780-8ac2-cac44e992df0"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:42:43.225136 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-80b8076f-9700-435c-a3b1-d6cb91349f4f req-72f67a91-3f51-476d-a43f-e22daffa5089 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:43.225675 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-80b8076f-9700-435c-a3b1-d6cb91349f4f req-72f67a91-3f51-476d-a43f-e22daffa5089 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:43.226105 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-80b8076f-9700-435c-a3b1-d6cb91349f4f req-72f67a91-3f51-476d-a43f-e22daffa5089 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:43.252707 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-80b8076f-9700-435c-a3b1-d6cb91349f4f req-72f67a91-3f51-476d-a43f-e22daffa5089 service nova] Creating event network-changed:8a88b191-41e1-4780-8ac2-cac44e992df0 for instance 65eefee7-f977-45ba-92a9-d0a97facdad7 on hv-cinder-85600 Sep 06 04:42:43.257721 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-80b8076f-9700-435c-a3b1-d6cb91349f4f req-72f67a91-3f51-476d-a43f-e22daffa5089 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054910 Sep 06 04:42:43.258573 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 352/726] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:42:43.398633 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1da6dd8c-4edd-42c5-967a-dafbc62232d4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:43.401533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d0769562-5feb-4789-a0ea-0e4b829451f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:43.402529 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d0769562-5feb-4789-a0ea-0e4b829451f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:43.410250 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d0769562-5feb-4789-a0ea-0e4b829451f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:43.411266 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1da6dd8c-4edd-42c5-967a-dafbc62232d4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:43.411913 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d0769562-5feb-4789-a0ea-0e4b829451f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:43.412337 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d0769562-5feb-4789-a0ea-0e4b829451f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:43.413186 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d0769562-5feb-4789-a0ea-0e4b829451f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:43.413884 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1da6dd8c-4edd-42c5-967a-dafbc62232d4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:43.414271 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d0769562-5feb-4789-a0ea-0e4b829451f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:43.414846 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d0769562-5feb-4789-a0ea-0e4b829451f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:43.415549 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1da6dd8c-4edd-42c5-967a-dafbc62232d4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.257184 Sep 06 04:42:43.416496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 375/727] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:42:43 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:42:43.589916 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-176e9a1a-72bc-4f93-b72a-4b32218d18ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:43.589916 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-176e9a1a-72bc-4f93-b72a-4b32218d18ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:43.599196 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-176e9a1a-72bc-4f93-b72a-4b32218d18ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:43.599991 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-176e9a1a-72bc-4f93-b72a-4b32218d18ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:43.600812 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-176e9a1a-72bc-4f93-b72a-4b32218d18ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:43.601762 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-176e9a1a-72bc-4f93-b72a-4b32218d18ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:43.602456 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-176e9a1a-72bc-4f93-b72a-4b32218d18ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:43.603027 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-176e9a1a-72bc-4f93-b72a-4b32218d18ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:43.650662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d0769562-5feb-4789-a0ea-0e4b829451f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:43.659898 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d0769562-5feb-4789-a0ea-0e4b829451f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1368 microversion: 2.1 time: 0.263829 Sep 06 04:42:43.661353 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 353/728] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:43 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:42:43.992128 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-176e9a1a-72bc-4f93-b72a-4b32218d18ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:43.996116 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:44.005887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-176e9a1a-72bc-4f93-b72a-4b32218d18ab tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1265 microversion: 2.1 time: 0.422539 Sep 06 04:42:44.008191 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 376/729] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:43 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1265 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:42:44.447638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4663d46d-5883-4c5e-bbfe-6b7b6c342bbb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:44.449033 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4663d46d-5883-4c5e-bbfe-6b7b6c342bbb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:44.463250 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4663d46d-5883-4c5e-bbfe-6b7b6c342bbb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:44.463893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4663d46d-5883-4c5e-bbfe-6b7b6c342bbb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:44.464377 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4663d46d-5883-4c5e-bbfe-6b7b6c342bbb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:44.466145 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4663d46d-5883-4c5e-bbfe-6b7b6c342bbb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:44.466145 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4663d46d-5883-4c5e-bbfe-6b7b6c342bbb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:44.466145 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4663d46d-5883-4c5e-bbfe-6b7b6c342bbb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:44.647704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4663d46d-5883-4c5e-bbfe-6b7b6c342bbb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:44.674086 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4663d46d-5883-4c5e-bbfe-6b7b6c342bbb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:44.676872 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4663d46d-5883-4c5e-bbfe-6b7b6c342bbb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:44.679583 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4663d46d-5883-4c5e-bbfe-6b7b6c342bbb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1723 microversion: 2.20 time: 0.241324 Sep 06 04:42:44.680964 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 354/730] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:42:44 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:42:44.686655 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-458775dc-736c-4cc8-a3a3-55da6122a308 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:44.687920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-458775dc-736c-4cc8-a3a3-55da6122a308 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:44.698944 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-458775dc-736c-4cc8-a3a3-55da6122a308 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:44.704340 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-458775dc-736c-4cc8-a3a3-55da6122a308 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:44.704340 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-458775dc-736c-4cc8-a3a3-55da6122a308 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:44.704340 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-458775dc-736c-4cc8-a3a3-55da6122a308 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:44.704340 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-458775dc-736c-4cc8-a3a3-55da6122a308 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:44.704801 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-458775dc-736c-4cc8-a3a3-55da6122a308 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:45.033879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2acb008a-87a9-4ef4-b58f-81e89008f483 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:45.034772 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2acb008a-87a9-4ef4-b58f-81e89008f483 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:45.042200 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2acb008a-87a9-4ef4-b58f-81e89008f483 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:45.042937 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2acb008a-87a9-4ef4-b58f-81e89008f483 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:45.043541 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2acb008a-87a9-4ef4-b58f-81e89008f483 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:45.044401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2acb008a-87a9-4ef4-b58f-81e89008f483 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:45.045008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2acb008a-87a9-4ef4-b58f-81e89008f483 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:45.045637 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2acb008a-87a9-4ef4-b58f-81e89008f483 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:45.239514 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-458775dc-736c-4cc8-a3a3-55da6122a308 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:45.253738 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-458775dc-736c-4cc8-a3a3-55da6122a308 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1558 microversion: 2.1 time: 0.573936 Sep 06 04:42:45.256185 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 377/731] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:44 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1558 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:45.277382 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5498d80c-c862-4c84-bcd2-1f4ca87c56ec tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:45.282901 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5498d80c-c862-4c84-bcd2-1f4ca87c56ec tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:45.296920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5498d80c-c862-4c84-bcd2-1f4ca87c56ec tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:45.297742 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5498d80c-c862-4c84-bcd2-1f4ca87c56ec tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:45.298344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5498d80c-c862-4c84-bcd2-1f4ca87c56ec tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:45.299661 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5498d80c-c862-4c84-bcd2-1f4ca87c56ec tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:45.300395 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5498d80c-c862-4c84-bcd2-1f4ca87c56ec tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:45.300982 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5498d80c-c862-4c84-bcd2-1f4ca87c56ec tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:45.484508 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5498d80c-c862-4c84-bcd2-1f4ca87c56ec tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211217 Sep 06 04:42:45.487610 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 378/732] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Sep 6 04:42:45 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/os-interface => generated 284 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:42:45.532229 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2acb008a-87a9-4ef4-b58f-81e89008f483 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:45.547102 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2acb008a-87a9-4ef4-b58f-81e89008f483 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1265 microversion: 2.1 time: 0.517367 Sep 06 04:42:45.549062 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 355/733] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:45 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1265 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:42:45.724581 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cbd90c42-5248-48d2-8066-c95dbb93ff93 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:45.724581 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cbd90c42-5248-48d2-8066-c95dbb93ff93 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:45.733418 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbd90c42-5248-48d2-8066-c95dbb93ff93 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:45.734266 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbd90c42-5248-48d2-8066-c95dbb93ff93 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:45.734879 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbd90c42-5248-48d2-8066-c95dbb93ff93 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:45.735916 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbd90c42-5248-48d2-8066-c95dbb93ff93 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:45.737438 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbd90c42-5248-48d2-8066-c95dbb93ff93 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:45.738249 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cbd90c42-5248-48d2-8066-c95dbb93ff93 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:45.901463 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cbd90c42-5248-48d2-8066-c95dbb93ff93 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:45.915721 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cbd90c42-5248-48d2-8066-c95dbb93ff93 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:45.918226 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cbd90c42-5248-48d2-8066-c95dbb93ff93 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:45.923112 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cbd90c42-5248-48d2-8066-c95dbb93ff93 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1657 microversion: 2.20 time: 0.219647 Sep 06 04:42:45.926336 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 379/734] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:42:45 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1657 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:42:46.255623 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-16ce0cec-00d8-45f6-89f5-341ad35973a7 req-65b6ae3c-4344-4f8c-a19d-fc80460072d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53238a8f-2601-4952-acd2-4dcb02761c12", "name": "network-vif-deleted", "tag": "19322183-60e8-44ac-b690-7448dfce3250"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:42:46.264045 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:46.265072 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:46.267273 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-16ce0cec-00d8-45f6-89f5-341ad35973a7 req-65b6ae3c-4344-4f8c-a19d-fc80460072d0 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:46.268578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-16ce0cec-00d8-45f6-89f5-341ad35973a7 req-65b6ae3c-4344-4f8c-a19d-fc80460072d0 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:46.269356 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-16ce0cec-00d8-45f6-89f5-341ad35973a7 req-65b6ae3c-4344-4f8c-a19d-fc80460072d0 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:46.281336 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-16ce0cec-00d8-45f6-89f5-341ad35973a7 req-65b6ae3c-4344-4f8c-a19d-fc80460072d0 service nova] Creating event network-vif-deleted:19322183-60e8-44ac-b690-7448dfce3250 for instance 53238a8f-2601-4952-acd2-4dcb02761c12 on hv-cinder-85600 Sep 06 04:42:46.287344 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-16ce0cec-00d8-45f6-89f5-341ad35973a7 req-65b6ae3c-4344-4f8c-a19d-fc80460072d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035989 Sep 06 04:42:46.288285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 356/735] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:42:46.571635 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a9b149ae-446e-4f80-8d5d-4944f75c64bf tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:46.572173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a9b149ae-446e-4f80-8d5d-4944f75c64bf tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:46.574336 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:46.579234 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9b149ae-446e-4f80-8d5d-4944f75c64bf tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:46.579764 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9b149ae-446e-4f80-8d5d-4944f75c64bf tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:46.580816 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9b149ae-446e-4f80-8d5d-4944f75c64bf tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:46.581753 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9b149ae-446e-4f80-8d5d-4944f75c64bf tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:46.582213 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9b149ae-446e-4f80-8d5d-4944f75c64bf tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:46.582646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a9b149ae-446e-4f80-8d5d-4944f75c64bf tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:46.961858 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:46.963247 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:46.970724 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:46.971323 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:46.971999 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:46.973056 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:46.973715 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:46.974137 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:47.031397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:47.031892 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:47.032333 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:47.032803 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lazy-loading 'fault' on Instance uuid 53238a8f-2601-4952-acd2-4dcb02761c12 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:42:47.085658 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:47.094977 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:47.096782 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:47.100087 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-640d39cc-c239-440a-9575-74e8a2d397ff tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 200 len: 1372 microversion: 2.20 time: 0.142936 Sep 06 04:42:47.100087 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 357/736] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:42:46 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 1372 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:42:47.169868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a9b149ae-446e-4f80-8d5d-4944f75c64bf tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:47.184258 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a9b149ae-446e-4f80-8d5d-4944f75c64bf tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1265 microversion: 2.1 time: 0.616812 Sep 06 04:42:47.187999 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 380/737] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:46 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1265 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:48.133761 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e6f77faa-0b08-4add-a452-44382a595c6a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:48.134577 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e6f77faa-0b08-4add-a452-44382a595c6a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:48.141454 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6f77faa-0b08-4add-a452-44382a595c6a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:48.142168 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6f77faa-0b08-4add-a452-44382a595c6a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:48.143092 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6f77faa-0b08-4add-a452-44382a595c6a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:48.144340 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6f77faa-0b08-4add-a452-44382a595c6a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:48.145111 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6f77faa-0b08-4add-a452-44382a595c6a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:48.145737 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6f77faa-0b08-4add-a452-44382a595c6a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:48.162528 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-e6f77faa-0b08-4add-a452-44382a595c6a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] HTTP exception thrown: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e6f77faa-0b08-4add-a452-44382a595c6a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Request method failure captured: Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 HTTP/1.1 Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4TMaQH41LYRJ4gx3sHLOhuJ8Ig4melyVWFfJGGJH_dZ9qGVDO-gwJMBB5z4fPFWkE5u6eznYLGcJrTN4UFVMiBfsCEVFM2kyY0_TLVdZxQ4fnVaF-fOgVIapjtC4qm53UhbdWZN_KgLpD3Nn5p8Y4ELqZU7F19HEEeBvVvFoHqXQs Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 2388589a34d346f3b31b231a9dafe34d Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:42:48.165213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:42:48.166847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:42:48.166847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:42:48.166847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 2388589a34d346f3b31b231a9dafe34d Sep 06 04:42:48.166847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:42:48.166847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeShelveTestJSON-727986358-project Sep 06 04:42:48.166847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:42:48.166847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:42:48.166847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 1ca147cfc97149dd87e533123a262cfd Sep 06 04:42:48.166847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-727986358-project Sep 06 04:42:48.166847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:42:48.166847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. Sep 06 04:42:48.166847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '53238a8f-2601-4952-acd2-4dcb02761c12'} Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:42:48.168046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. Sep 06 04:42:48.169729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:42:48.171341 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e6f77faa-0b08-4add-a452-44382a595c6a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Returning 404 to user: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:42:48.171341 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e6f77faa-0b08-4add-a452-44382a595c6a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 404 len: 111 microversion: 2.20 time: 0.039693 Sep 06 04:42:48.171341 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 358/738] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:42:48 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 04:42:48.177178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cc324761-b7a9-46c0-a0e2-7d91a32966de tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '.version_select at 0x7f31764d0ee0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:48.211784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-625eef35-56ba-4f0e-8d00-0e95eae169e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:48.212501 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-625eef35-56ba-4f0e-8d00-0e95eae169e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:48.221182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-625eef35-56ba-4f0e-8d00-0e95eae169e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:48.221748 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-625eef35-56ba-4f0e-8d00-0e95eae169e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:48.222180 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-625eef35-56ba-4f0e-8d00-0e95eae169e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:48.222906 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-625eef35-56ba-4f0e-8d00-0e95eae169e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:48.223626 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-625eef35-56ba-4f0e-8d00-0e95eae169e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:48.224044 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-625eef35-56ba-4f0e-8d00-0e95eae169e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:48.308868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cc324761-b7a9-46c0-a0e2-7d91a32966de tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1166574110" status: 204 len: 0 microversion: 2.20 time: 0.136525 Sep 06 04:42:48.309502 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 381/739] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Sep 6 04:42:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1166574110 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 04:42:48.324785 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-f9235e4d-e619-48bd-a125-ab0b1bcdb6e4 req-2e6a9373-9824-4f3f-b57a-16053c7411e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6059864b-289a-4aa6-85b9-9041ca7e9d2d", "tag": "e194fb45-529b-4235-84c0-becbe4954bd3"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:42:48.356245 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-f9235e4d-e619-48bd-a125-ab0b1bcdb6e4 req-2e6a9373-9824-4f3f-b57a-16053c7411e1 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:48.356724 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-f9235e4d-e619-48bd-a125-ab0b1bcdb6e4 req-2e6a9373-9824-4f3f-b57a-16053c7411e1 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:48.359920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-f9235e4d-e619-48bd-a125-ab0b1bcdb6e4 req-2e6a9373-9824-4f3f-b57a-16053c7411e1 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:48.379926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-f9235e4d-e619-48bd-a125-ab0b1bcdb6e4 req-2e6a9373-9824-4f3f-b57a-16053c7411e1 service nova] Creating event network-changed:e194fb45-529b-4235-84c0-becbe4954bd3 for instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d on hv-cinder-85600 Sep 06 04:42:48.386099 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-f9235e4d-e619-48bd-a125-ab0b1bcdb6e4 req-2e6a9373-9824-4f3f-b57a-16053c7411e1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074774 Sep 06 04:42:48.386945 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 382/740] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:42:48.442212 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-625eef35-56ba-4f0e-8d00-0e95eae169e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:48.453921 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-625eef35-56ba-4f0e-8d00-0e95eae169e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1265 microversion: 2.1 time: 0.243813 Sep 06 04:42:48.453921 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 359/741] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:48 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:49.484191 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9ab309f4-021f-4e2d-84cf-0d2ff6464dd1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:49.494986 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9ab309f4-021f-4e2d-84cf-0d2ff6464dd1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:49.507909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ab309f4-021f-4e2d-84cf-0d2ff6464dd1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:49.509521 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ab309f4-021f-4e2d-84cf-0d2ff6464dd1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:49.510241 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ab309f4-021f-4e2d-84cf-0d2ff6464dd1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:49.525411 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ab309f4-021f-4e2d-84cf-0d2ff6464dd1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:49.526326 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ab309f4-021f-4e2d-84cf-0d2ff6464dd1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:49.527985 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9ab309f4-021f-4e2d-84cf-0d2ff6464dd1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:49.717295 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-af4c868c-f6a9-48a7-9141-9aaacdff2b41 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Action: 'create', calling method: .version_select at 0x7f3176579550>, body: {"keypair": {"name": "tempest-keypair-373883510", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCrAf++ndUX6qhq1SMwrc1QuRGpC+cdt2xAHUaAYpb6c9rvndyV0ni4Z21tIWH0olJAJPdb8X/dz1GFDeC1R9tFZa0v/++xCJVYfIXq1l9D86df9NrBdNgR2r3CFYPNhGA=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:42:49.733286 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9ab309f4-021f-4e2d-84cf-0d2ff6464dd1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:49.744032 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9ab309f4-021f-4e2d-84cf-0d2ff6464dd1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1265 microversion: 2.1 time: 0.266088 Sep 06 04:42:49.744765 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 383/742] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:49 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:49.757570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-af4c868c-f6a9-48a7-9141-9aaacdff2b41 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Getting quotas for project 2388589a34d346f3b31b231a9dafe34d. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:42:49.763155 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-af4c868c-f6a9-48a7-9141-9aaacdff2b41 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Getting quotas for user 1ca147cfc97149dd87e533123a262cfd and project 2388589a34d346f3b31b231a9dafe34d. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:42:49.966572 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-af4c868c-f6a9-48a7-9141-9aaacdff2b41 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.253367 Sep 06 04:42:49.967467 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 360/743] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Sep 6 04:42:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 255 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 06 04:42:50.768090 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a8555e74-0334-4109-9640-8a7d8505a420 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:50.768734 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a8555e74-0334-4109-9640-8a7d8505a420 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:50.775879 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8555e74-0334-4109-9640-8a7d8505a420 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:50.776688 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8555e74-0334-4109-9640-8a7d8505a420 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:50.777328 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8555e74-0334-4109-9640-8a7d8505a420 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:50.778478 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8555e74-0334-4109-9640-8a7d8505a420 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:50.779084 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8555e74-0334-4109-9640-8a7d8505a420 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:50.779665 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8555e74-0334-4109-9640-8a7d8505a420 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:50.977805 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a8555e74-0334-4109-9640-8a7d8505a420 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:50.996944 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a8555e74-0334-4109-9640-8a7d8505a420 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1265 microversion: 2.1 time: 0.233438 Sep 06 04:42:50.998136 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 384/744] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:50 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:52.184693 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2a9bbf99-9c3a-43ea-a17a-6dc303a720ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:52.185365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2a9bbf99-9c3a-43ea-a17a-6dc303a720ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:52.200686 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a9bbf99-9c3a-43ea-a17a-6dc303a720ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:52.201608 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a9bbf99-9c3a-43ea-a17a-6dc303a720ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:52.202281 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a9bbf99-9c3a-43ea-a17a-6dc303a720ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:52.204045 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a9bbf99-9c3a-43ea-a17a-6dc303a720ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:52.205808 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a9bbf99-9c3a-43ea-a17a-6dc303a720ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:52.206298 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a9bbf99-9c3a-43ea-a17a-6dc303a720ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:52.462996 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2a9bbf99-9c3a-43ea-a17a-6dc303a720ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:52.474383 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2a9bbf99-9c3a-43ea-a17a-6dc303a720ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1265 microversion: 2.1 time: 0.454198 Sep 06 04:42:52.475626 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 361/745] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:52 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1265 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:52.826419 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1977795415", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6861b199-7de9-4155-8c49-44122ab810f3"}], "security_groups": [{"name": "tempest-securitygroup--1334344137"}], "key_name": "tempest-keypair-373883510", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:42:52.964814 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] validate_networks() for [('6861b199-7de9-4155-8c49-44122ab810f3', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:42:53.505755 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0ec2bb38-80d2-4eaf-82e3-bfad7b5f6347 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:53.508037 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0ec2bb38-80d2-4eaf-82e3-bfad7b5f6347 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:53.515180 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ec2bb38-80d2-4eaf-82e3-bfad7b5f6347 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:53.538198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ec2bb38-80d2-4eaf-82e3-bfad7b5f6347 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:53.538662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ec2bb38-80d2-4eaf-82e3-bfad7b5f6347 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:53.542123 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ec2bb38-80d2-4eaf-82e3-bfad7b5f6347 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:53.545038 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ec2bb38-80d2-4eaf-82e3-bfad7b5f6347 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:53.545515 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ec2bb38-80d2-4eaf-82e3-bfad7b5f6347 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:53.668252 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:42:53.668252 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:42:53.668252 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:42:53.668252 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:42:53.668252 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:42:53.687293 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:53.688247 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:53.688888 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:53.689754 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:53.690651 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:53.691273 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:53.724344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Getting quotas for project 2388589a34d346f3b31b231a9dafe34d. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:42:53.729827 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Getting quotas for user 1ca147cfc97149dd87e533123a262cfd and project 2388589a34d346f3b31b231a9dafe34d. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:42:53.742404 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:42:53.744861 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:42:53.822173 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0ec2bb38-80d2-4eaf-82e3-bfad7b5f6347 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:53.831886 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0ec2bb38-80d2-4eaf-82e3-bfad7b5f6347 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1265 microversion: 2.1 time: 0.336014 Sep 06 04:42:53.832747 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 362/746] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:53 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1265 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:54.112924 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f147cdcf-19af-4f42-8a3a-40142fb85205 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.290859 Sep 06 04:42:54.113915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 385/747] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Sep 6 04:42:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 06 04:42:54.124979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5f323ab6-2f49-4bc2-a1d3-dff63a88736d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:54.125659 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5f323ab6-2f49-4bc2-a1d3-dff63a88736d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:54.220208 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5f323ab6-2f49-4bc2-a1d3-dff63a88736d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:54.230995 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5f323ab6-2f49-4bc2-a1d3-dff63a88736d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:54.232894 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5f323ab6-2f49-4bc2-a1d3-dff63a88736d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:54.234881 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5f323ab6-2f49-4bc2-a1d3-dff63a88736d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1281 microversion: 2.20 time: 0.113952 Sep 06 04:42:54.246028 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 363/748] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:42:54 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1281 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:42:54.856604 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fb5d8db2-735d-4eb6-ae41-695d85b33dc6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:54.857212 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fb5d8db2-735d-4eb6-ae41-695d85b33dc6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:54.866860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb5d8db2-735d-4eb6-ae41-695d85b33dc6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:54.867413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb5d8db2-735d-4eb6-ae41-695d85b33dc6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:54.868208 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb5d8db2-735d-4eb6-ae41-695d85b33dc6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:54.869114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb5d8db2-735d-4eb6-ae41-695d85b33dc6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:54.869758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb5d8db2-735d-4eb6-ae41-695d85b33dc6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:54.870343 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fb5d8db2-735d-4eb6-ae41-695d85b33dc6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:55.177453 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fb5d8db2-735d-4eb6-ae41-695d85b33dc6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:55.194343 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fb5d8db2-735d-4eb6-ae41-695d85b33dc6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1265 microversion: 2.1 time: 0.341984 Sep 06 04:42:55.210617 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 386/749] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:54 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1265 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:55.216312 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d025cade-3308-427d-9648-c72edee650db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:55.216897 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d025cade-3308-427d-9648-c72edee650db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:55.230254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d025cade-3308-427d-9648-c72edee650db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:55.230753 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d025cade-3308-427d-9648-c72edee650db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:55.231185 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d025cade-3308-427d-9648-c72edee650db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:55.232035 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d025cade-3308-427d-9648-c72edee650db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:55.232496 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d025cade-3308-427d-9648-c72edee650db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:55.232915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d025cade-3308-427d-9648-c72edee650db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:55.273794 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4ed602dc-ec60-4153-94e9-7d9f9843c59c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:55.277516 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4ed602dc-ec60-4153-94e9-7d9f9843c59c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:55.289249 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ed602dc-ec60-4153-94e9-7d9f9843c59c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:55.291507 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ed602dc-ec60-4153-94e9-7d9f9843c59c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:55.292549 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ed602dc-ec60-4153-94e9-7d9f9843c59c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:55.294940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ed602dc-ec60-4153-94e9-7d9f9843c59c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:55.295605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ed602dc-ec60-4153-94e9-7d9f9843c59c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:55.296688 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ed602dc-ec60-4153-94e9-7d9f9843c59c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:55.438025 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-d025cade-3308-427d-9648-c72edee650db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lazy-loading 'services' on Instance uuid 4631439d-ba1a-4895-88bc-66f83e93defa {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:42:55.444187 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4ed602dc-ec60-4153-94e9-7d9f9843c59c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:55.475019 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4ed602dc-ec60-4153-94e9-7d9f9843c59c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:55.480655 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4ed602dc-ec60-4153-94e9-7d9f9843c59c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:55.484086 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4ed602dc-ec60-4153-94e9-7d9f9843c59c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1285 microversion: 2.20 time: 0.213621 Sep 06 04:42:55.504822 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 387/750] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:42:55 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1285 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:42:55.724317 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d025cade-3308-427d-9648-c72edee650db tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-volume_attachments/e8808f00-b1d4-49cd-8b79-a2c5b41ac191" status: 202 len: 0 microversion: 2.1 time: 0.512358 Sep 06 04:42:55.725562 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 364/751] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Sep 6 04:42:55 2022] DELETE /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-volume_attachments/e8808f00-b1d4-49cd-8b79-a2c5b41ac191 => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 04:42:55.734416 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-00c7142f-0f2d-428a-a445-8ac5f446d870 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:55.737267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-00c7142f-0f2d-428a-a445-8ac5f446d870 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:55.754966 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00c7142f-0f2d-428a-a445-8ac5f446d870 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:55.755470 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00c7142f-0f2d-428a-a445-8ac5f446d870 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:55.756036 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00c7142f-0f2d-428a-a445-8ac5f446d870 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:55.756693 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00c7142f-0f2d-428a-a445-8ac5f446d870 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:55.757144 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00c7142f-0f2d-428a-a445-8ac5f446d870 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:55.762685 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00c7142f-0f2d-428a-a445-8ac5f446d870 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:55.809825 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-00c7142f-0f2d-428a-a445-8ac5f446d870 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079473 Sep 06 04:42:55.810768 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 388/752] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:42:55 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:42:56.242925 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-62e25fa2-39d9-469d-9be1-8c1faa2b3506 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:56.243621 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-62e25fa2-39d9-469d-9be1-8c1faa2b3506 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:56.266807 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-62e25fa2-39d9-469d-9be1-8c1faa2b3506 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:56.267570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-62e25fa2-39d9-469d-9be1-8c1faa2b3506 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:56.270004 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-62e25fa2-39d9-469d-9be1-8c1faa2b3506 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:56.270728 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-62e25fa2-39d9-469d-9be1-8c1faa2b3506 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:56.271922 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-62e25fa2-39d9-469d-9be1-8c1faa2b3506 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:56.272351 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-62e25fa2-39d9-469d-9be1-8c1faa2b3506 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:56.449808 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-62e25fa2-39d9-469d-9be1-8c1faa2b3506 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:56.460293 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-62e25fa2-39d9-469d-9be1-8c1faa2b3506 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1265 microversion: 2.1 time: 0.226713 Sep 06 04:42:56.461975 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 365/753] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:56 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:56.512419 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d5fb7862-4ff3-4202-bdff-c935bc91611f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:56.513758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d5fb7862-4ff3-4202-bdff-c935bc91611f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:56.522168 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5fb7862-4ff3-4202-bdff-c935bc91611f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:56.523135 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5fb7862-4ff3-4202-bdff-c935bc91611f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:56.523754 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5fb7862-4ff3-4202-bdff-c935bc91611f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:56.524632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5fb7862-4ff3-4202-bdff-c935bc91611f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:56.525236 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5fb7862-4ff3-4202-bdff-c935bc91611f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:56.526258 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d5fb7862-4ff3-4202-bdff-c935bc91611f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:56.608755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d5fb7862-4ff3-4202-bdff-c935bc91611f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:56.617907 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d5fb7862-4ff3-4202-bdff-c935bc91611f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:56.619880 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d5fb7862-4ff3-4202-bdff-c935bc91611f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:56.621211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d5fb7862-4ff3-4202-bdff-c935bc91611f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1333 microversion: 2.20 time: 0.113954 Sep 06 04:42:56.621997 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 389/754] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:42:56 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1333 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:42:56.822592 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e1bdfb75-03ac-48cc-bac3-6b288a9d9823 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:56.825462 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e1bdfb75-03ac-48cc-bac3-6b288a9d9823 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:56.831968 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1bdfb75-03ac-48cc-bac3-6b288a9d9823 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:56.832674 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1bdfb75-03ac-48cc-bac3-6b288a9d9823 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:56.833395 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1bdfb75-03ac-48cc-bac3-6b288a9d9823 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:56.834167 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1bdfb75-03ac-48cc-bac3-6b288a9d9823 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:56.834697 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1bdfb75-03ac-48cc-bac3-6b288a9d9823 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:56.835213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1bdfb75-03ac-48cc-bac3-6b288a9d9823 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:56.871212 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e1bdfb75-03ac-48cc-bac3-6b288a9d9823 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052839 Sep 06 04:42:56.872150 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 366/755] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:42:56 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:42:57.484085 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c4d3e6f5-f3d4-498f-bc84-113151e79539 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:57.484690 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c4d3e6f5-f3d4-498f-bc84-113151e79539 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:57.493468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c4d3e6f5-f3d4-498f-bc84-113151e79539 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:57.493952 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c4d3e6f5-f3d4-498f-bc84-113151e79539 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:57.494387 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c4d3e6f5-f3d4-498f-bc84-113151e79539 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:57.495069 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c4d3e6f5-f3d4-498f-bc84-113151e79539 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:57.495524 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c4d3e6f5-f3d4-498f-bc84-113151e79539 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:57.495941 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c4d3e6f5-f3d4-498f-bc84-113151e79539 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:57.650130 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c4d3e6f5-f3d4-498f-bc84-113151e79539 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:57.662864 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c9f94faa-d4f0-4f3a-b023-7c5a9dac71ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:57.667657 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c9f94faa-d4f0-4f3a-b023-7c5a9dac71ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:57.674882 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9f94faa-d4f0-4f3a-b023-7c5a9dac71ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:57.675644 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9f94faa-d4f0-4f3a-b023-7c5a9dac71ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:57.676297 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9f94faa-d4f0-4f3a-b023-7c5a9dac71ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:57.677165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9f94faa-d4f0-4f3a-b023-7c5a9dac71ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:57.677893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9f94faa-d4f0-4f3a-b023-7c5a9dac71ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:57.678699 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c9f94faa-d4f0-4f3a-b023-7c5a9dac71ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:57.679377 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c4d3e6f5-f3d4-498f-bc84-113151e79539 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1265 microversion: 2.1 time: 0.197418 Sep 06 04:42:57.686190 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 390/756] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:57 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:57.770550 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c9f94faa-d4f0-4f3a-b023-7c5a9dac71ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:57.782465 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c9f94faa-d4f0-4f3a-b023-7c5a9dac71ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:57.785168 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c9f94faa-d4f0-4f3a-b023-7c5a9dac71ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:57.786964 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c9f94faa-d4f0-4f3a-b023-7c5a9dac71ee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1341 microversion: 2.20 time: 0.129514 Sep 06 04:42:57.802574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 367/757] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:42:57 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1341 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:42:57.884865 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4be0d007-e5e9-4c1e-aab9-431f3682d75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:57.887859 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4be0d007-e5e9-4c1e-aab9-431f3682d75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:57.902274 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4be0d007-e5e9-4c1e-aab9-431f3682d75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:57.903028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4be0d007-e5e9-4c1e-aab9-431f3682d75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:57.903469 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4be0d007-e5e9-4c1e-aab9-431f3682d75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:57.904197 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4be0d007-e5e9-4c1e-aab9-431f3682d75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:57.904677 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4be0d007-e5e9-4c1e-aab9-431f3682d75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:57.905072 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4be0d007-e5e9-4c1e-aab9-431f3682d75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:57.960461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4be0d007-e5e9-4c1e-aab9-431f3682d75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079609 Sep 06 04:42:57.961986 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 391/758] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:42:57 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 04:42:58.014781 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-a6c77be8-9fa6-4f5e-ae1a-179efc29fd77 req-8894e687-84bf-44a5-8a59-334af23fa4fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65eefee7-f977-45ba-92a9-d0a97facdad7", "name": "network-vif-plugged", "status": "completed", "tag": "8a88b191-41e1-4780-8ac2-cac44e992df0"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:42:58.044897 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a6c77be8-9fa6-4f5e-ae1a-179efc29fd77 req-8894e687-84bf-44a5-8a59-334af23fa4fd service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:58.046098 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a6c77be8-9fa6-4f5e-ae1a-179efc29fd77 req-8894e687-84bf-44a5-8a59-334af23fa4fd service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:58.052141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a6c77be8-9fa6-4f5e-ae1a-179efc29fd77 req-8894e687-84bf-44a5-8a59-334af23fa4fd service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:58.070101 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-a6c77be8-9fa6-4f5e-ae1a-179efc29fd77 req-8894e687-84bf-44a5-8a59-334af23fa4fd service nova] Creating event network-vif-plugged:8a88b191-41e1-4780-8ac2-cac44e992df0 for instance 65eefee7-f977-45ba-92a9-d0a97facdad7 on hv-cinder-85600 Sep 06 04:42:58.076845 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cc3199bd-4818-496d-9b5a-f414beffc9b6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:58.077707 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cc3199bd-4818-496d-9b5a-f414beffc9b6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:58.090057 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cc3199bd-4818-496d-9b5a-f414beffc9b6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:58.091912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cc3199bd-4818-496d-9b5a-f414beffc9b6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:58.092861 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-a6c77be8-9fa6-4f5e-ae1a-179efc29fd77 req-8894e687-84bf-44a5-8a59-334af23fa4fd service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085494 Sep 06 04:42:58.093549 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cc3199bd-4818-496d-9b5a-f414beffc9b6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:58.094288 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cc3199bd-4818-496d-9b5a-f414beffc9b6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:58.095046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 368/759] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:42:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:42:58.095770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cc3199bd-4818-496d-9b5a-f414beffc9b6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:58.096341 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cc3199bd-4818-496d-9b5a-f414beffc9b6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:58.130894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cc3199bd-4818-496d-9b5a-f414beffc9b6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:42:58.485276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cc3199bd-4818-496d-9b5a-f414beffc9b6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 204 len: 0 microversion: 2.1 time: 0.411336 Sep 06 04:42:58.486403 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 392/760] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:42:58 2022] DELETE /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 04:42:58.499426 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-81df7f03-4c2e-401a-979b-04d786647fa8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:58.500409 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-81df7f03-4c2e-401a-979b-04d786647fa8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:58.510840 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81df7f03-4c2e-401a-979b-04d786647fa8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:58.511605 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81df7f03-4c2e-401a-979b-04d786647fa8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:58.512760 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81df7f03-4c2e-401a-979b-04d786647fa8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:58.513830 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81df7f03-4c2e-401a-979b-04d786647fa8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:58.514449 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81df7f03-4c2e-401a-979b-04d786647fa8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:58.515034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-81df7f03-4c2e-401a-979b-04d786647fa8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:58.676274 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-81df7f03-4c2e-401a-979b-04d786647fa8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:58.691380 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-81df7f03-4c2e-401a-979b-04d786647fa8 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1688 microversion: 2.1 time: 0.199595 Sep 06 04:42:58.692580 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 369/761] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:58 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1688 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:58.703403 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-24f4dfba-ea33-4f74-bebe-52826d97feda tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:58.704194 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-24f4dfba-ea33-4f74-bebe-52826d97feda tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:58.714651 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24f4dfba-ea33-4f74-bebe-52826d97feda tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:58.715531 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24f4dfba-ea33-4f74-bebe-52826d97feda tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:58.716226 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24f4dfba-ea33-4f74-bebe-52826d97feda tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:58.717139 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24f4dfba-ea33-4f74-bebe-52826d97feda tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:58.717840 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24f4dfba-ea33-4f74-bebe-52826d97feda tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:58.718365 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-24f4dfba-ea33-4f74-bebe-52826d97feda tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:58.816005 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0e232105-7e27-404e-b928-0bc4fc1d315d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:58.818951 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0e232105-7e27-404e-b928-0bc4fc1d315d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:58.825645 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:58.827388 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e232105-7e27-404e-b928-0bc4fc1d315d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:58.828099 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e232105-7e27-404e-b928-0bc4fc1d315d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:58.829038 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e232105-7e27-404e-b928-0bc4fc1d315d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:58.836712 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e232105-7e27-404e-b928-0bc4fc1d315d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:58.837479 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e232105-7e27-404e-b928-0bc4fc1d315d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:58.838109 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0e232105-7e27-404e-b928-0bc4fc1d315d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:58.896153 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-24f4dfba-ea33-4f74-bebe-52826d97feda tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:58.910278 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0e232105-7e27-404e-b928-0bc4fc1d315d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:58.914501 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:58.919817 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0e232105-7e27-404e-b928-0bc4fc1d315d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:58.920569 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-24f4dfba-ea33-4f74-bebe-52826d97feda tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1265 microversion: 2.1 time: 0.208058 Sep 06 04:42:58.921848 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 393/762] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:58 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:58.924713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0e232105-7e27-404e-b928-0bc4fc1d315d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:58.926108 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0e232105-7e27-404e-b928-0bc4fc1d315d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1339 microversion: 2.20 time: 0.114857 Sep 06 04:42:58.939361 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 370/763] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:42:58 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1339 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:42:59.715323 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ef0d1150-6349-462c-ae83-37e2e578dcf1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:59.715844 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ef0d1150-6349-462c-ae83-37e2e578dcf1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:59.725509 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef0d1150-6349-462c-ae83-37e2e578dcf1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:59.725998 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef0d1150-6349-462c-ae83-37e2e578dcf1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:59.726606 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef0d1150-6349-462c-ae83-37e2e578dcf1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:59.727388 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef0d1150-6349-462c-ae83-37e2e578dcf1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:59.727842 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef0d1150-6349-462c-ae83-37e2e578dcf1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:59.728275 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef0d1150-6349-462c-ae83-37e2e578dcf1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:59.751367 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:42:59.878820 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ef0d1150-6349-462c-ae83-37e2e578dcf1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:42:59.887266 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ef0d1150-6349-462c-ae83-37e2e578dcf1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1688 microversion: 2.1 time: 0.175979 Sep 06 04:42:59.888203 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 394/764] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:59 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:42:59.944421 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3c88c2e4-570c-443b-a484-8a286d032cc2 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:59.945678 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3c88c2e4-570c-443b-a484-8a286d032cc2 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:59.952005 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-16211f2b-a0a1-4a81-8578-a1d1f7291ca7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:42:59.952607 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-16211f2b-a0a1-4a81-8578-a1d1f7291ca7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:42:59.953666 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c88c2e4-570c-443b-a484-8a286d032cc2 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:59.954146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c88c2e4-570c-443b-a484-8a286d032cc2 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:59.955359 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c88c2e4-570c-443b-a484-8a286d032cc2 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:59.956219 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c88c2e4-570c-443b-a484-8a286d032cc2 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:59.956671 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c88c2e4-570c-443b-a484-8a286d032cc2 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:59.957241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c88c2e4-570c-443b-a484-8a286d032cc2 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:59.965119 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-16211f2b-a0a1-4a81-8578-a1d1f7291ca7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:59.965745 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-16211f2b-a0a1-4a81-8578-a1d1f7291ca7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:59.966124 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-16211f2b-a0a1-4a81-8578-a1d1f7291ca7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:42:59.968134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-16211f2b-a0a1-4a81-8578-a1d1f7291ca7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:42:59.968595 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-16211f2b-a0a1-4a81-8578-a1d1f7291ca7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:42:59.969018 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-16211f2b-a0a1-4a81-8578-a1d1f7291ca7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:00.130184 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3c88c2e4-570c-443b-a484-8a286d032cc2 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:00.141821 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3c88c2e4-570c-443b-a484-8a286d032cc2 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1265 microversion: 2.1 time: 0.201044 Sep 06 04:43:00.142779 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 371/765] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:42:59 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:43:00.163265 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-16211f2b-a0a1-4a81-8578-a1d1f7291ca7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:00.172926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-16211f2b-a0a1-4a81-8578-a1d1f7291ca7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:00.174663 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-16211f2b-a0a1-4a81-8578-a1d1f7291ca7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:00.175888 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-16211f2b-a0a1-4a81-8578-a1d1f7291ca7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.227696 Sep 06 04:43:00.176458 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 395/766] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:42:59 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:43:00.912000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f717446a-bdc9-4df7-a546-176eeac23929 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:00.912615 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f717446a-bdc9-4df7-a546-176eeac23929 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:00.918727 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f717446a-bdc9-4df7-a546-176eeac23929 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:00.919212 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f717446a-bdc9-4df7-a546-176eeac23929 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:00.919644 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f717446a-bdc9-4df7-a546-176eeac23929 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:00.920325 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f717446a-bdc9-4df7-a546-176eeac23929 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:00.920782 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f717446a-bdc9-4df7-a546-176eeac23929 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:00.921193 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f717446a-bdc9-4df7-a546-176eeac23929 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:01.076922 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f717446a-bdc9-4df7-a546-176eeac23929 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:01.088656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f717446a-bdc9-4df7-a546-176eeac23929 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1688 microversion: 2.1 time: 0.181193 Sep 06 04:43:01.089449 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 372/767] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:00 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:01.168229 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d66d4d54-ac0a-46ae-b17d-0bf09876e2d8 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:01.168927 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d66d4d54-ac0a-46ae-b17d-0bf09876e2d8 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:01.172430 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:01.179560 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d66d4d54-ac0a-46ae-b17d-0bf09876e2d8 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:01.179875 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d66d4d54-ac0a-46ae-b17d-0bf09876e2d8 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:01.180679 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d66d4d54-ac0a-46ae-b17d-0bf09876e2d8 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:01.185906 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d66d4d54-ac0a-46ae-b17d-0bf09876e2d8 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:01.185906 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d66d4d54-ac0a-46ae-b17d-0bf09876e2d8 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:01.185906 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d66d4d54-ac0a-46ae-b17d-0bf09876e2d8 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:01.202161 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5af2dacc-7bf9-4b09-8069-3f32a72fe17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:01.202731 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5af2dacc-7bf9-4b09-8069-3f32a72fe17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:01.210688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5af2dacc-7bf9-4b09-8069-3f32a72fe17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:01.211177 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5af2dacc-7bf9-4b09-8069-3f32a72fe17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:01.211613 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5af2dacc-7bf9-4b09-8069-3f32a72fe17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:01.212314 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5af2dacc-7bf9-4b09-8069-3f32a72fe17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:01.212763 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5af2dacc-7bf9-4b09-8069-3f32a72fe17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:01.213878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5af2dacc-7bf9-4b09-8069-3f32a72fe17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:01.369382 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d66d4d54-ac0a-46ae-b17d-0bf09876e2d8 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:01.382806 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d66d4d54-ac0a-46ae-b17d-0bf09876e2d8 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1265 microversion: 2.1 time: 0.218285 Sep 06 04:43:01.388454 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 396/768] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:01 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:43:01.411619 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5af2dacc-7bf9-4b09-8069-3f32a72fe17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:01.422373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5af2dacc-7bf9-4b09-8069-3f32a72fe17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:01.424914 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5af2dacc-7bf9-4b09-8069-3f32a72fe17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:01.426290 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5af2dacc-7bf9-4b09-8069-3f32a72fe17f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.228338 Sep 06 04:43:01.427014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 373/769] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:01 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:43:02.118066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d01fafc0-1871-432d-a17e-0a09a72ab559 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:02.118677 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d01fafc0-1871-432d-a17e-0a09a72ab559 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:02.124586 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d01fafc0-1871-432d-a17e-0a09a72ab559 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:02.125074 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d01fafc0-1871-432d-a17e-0a09a72ab559 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:02.125563 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d01fafc0-1871-432d-a17e-0a09a72ab559 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:02.126257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d01fafc0-1871-432d-a17e-0a09a72ab559 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:02.126873 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d01fafc0-1871-432d-a17e-0a09a72ab559 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:02.127297 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d01fafc0-1871-432d-a17e-0a09a72ab559 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:02.202975 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0451ed29-96f7-45b0-80e4-3c7d4802691a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Action: 'create', calling method: .version_select at 0x7f317654bdc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-370372830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5UQlUTu7hSfWLoBqdeVUEXfQINjoZQY+rqEK5N55nBQ75pjEHIVxOETZrKbe/I1H5h+KYFGKjHl4Fk1uoofNpgZGUehHtjJlKGJeVXwwAy/1siV7VYlJDBaUgjvsng2g=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:02.218638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-0451ed29-96f7-45b0-80e4-3c7d4802691a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Getting quotas for project 623b9f3be0f24e2ea1caea0798b30704. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:43:02.223190 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-0451ed29-96f7-45b0-80e4-3c7d4802691a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Getting quotas for user 9f07caa54c8f47778bb984bfd9800dc0 and project 623b9f3be0f24e2ea1caea0798b30704. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:43:02.303380 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0451ed29-96f7-45b0-80e4-3c7d4802691a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.104053 Sep 06 04:43:02.304532 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 374/770] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Sep 6 04:43:02 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:43:02.349988 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d01fafc0-1871-432d-a17e-0a09a72ab559 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:02.356351 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-149579258", "imageRef": "746b1129-f16e-4823-b9ce-c90ce276f7ba", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-370372830", "networks": [{"uuid": "6b6abe5e-f7f6-488e-8814-260547c69a21"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:02.360246 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d01fafc0-1871-432d-a17e-0a09a72ab559 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1688 microversion: 2.1 time: 0.245949 Sep 06 04:43:02.369448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 397/771] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:02 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1688 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:02.406185 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ef6e0c58-9e9d-45ac-a122-a453813b6496 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:02.406785 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ef6e0c58-9e9d-45ac-a122-a453813b6496 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:02.413585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef6e0c58-9e9d-45ac-a122-a453813b6496 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:02.414067 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef6e0c58-9e9d-45ac-a122-a453813b6496 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:02.414493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef6e0c58-9e9d-45ac-a122-a453813b6496 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:02.415201 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef6e0c58-9e9d-45ac-a122-a453813b6496 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:02.415617 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef6e0c58-9e9d-45ac-a122-a453813b6496 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:02.416032 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef6e0c58-9e9d-45ac-a122-a453813b6496 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:02.419947 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] validate_networks() for [('6b6abe5e-f7f6-488e-8814-260547c69a21', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:43:02.606325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ef6e0c58-9e9d-45ac-a122-a453813b6496 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:02.614445 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ef6e0c58-9e9d-45ac-a122-a453813b6496 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1265 microversion: 2.1 time: 0.212287 Sep 06 04:43:02.615159 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 398/772] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:02 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:43:02.619893 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8c42634f-4f65-49b9-a803-f0aef04a0227 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:02.620768 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8c42634f-4f65-49b9-a803-f0aef04a0227 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:02.626671 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c42634f-4f65-49b9-a803-f0aef04a0227 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:02.627260 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c42634f-4f65-49b9-a803-f0aef04a0227 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:02.627809 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c42634f-4f65-49b9-a803-f0aef04a0227 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:02.628597 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c42634f-4f65-49b9-a803-f0aef04a0227 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:02.629151 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c42634f-4f65-49b9-a803-f0aef04a0227 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:02.629706 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c42634f-4f65-49b9-a803-f0aef04a0227 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:02.801685 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:43:02.802111 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:43:02.802589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:43:02.802997 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:43:02.803409 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:43:02.809273 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8c42634f-4f65-49b9-a803-f0aef04a0227 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:02.812676 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:02.813162 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:02.813624 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:02.815038 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:02.815758 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:02.816222 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:02.819244 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8c42634f-4f65-49b9-a803-f0aef04a0227 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:02.820895 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8c42634f-4f65-49b9-a803-f0aef04a0227 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:02.822059 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8c42634f-4f65-49b9-a803-f0aef04a0227 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.205911 Sep 06 04:43:02.822614 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 399/773] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:02 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:43:02.827041 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-3634e10d-20e5-400f-9d35-9b5dfb2c2320 req-75b8d806-6f9a-406e-a9ec-f2e86fee90db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "821737e4-9236-4f80-b1ac-8c4d16c02244", "tag": "3e4ec09b-2a4b-41e0-871c-50fd282365c6"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:02.835574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Getting quotas for project 623b9f3be0f24e2ea1caea0798b30704. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:43:02.837143 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3634e10d-20e5-400f-9d35-9b5dfb2c2320 req-75b8d806-6f9a-406e-a9ec-f2e86fee90db service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:02.837825 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3634e10d-20e5-400f-9d35-9b5dfb2c2320 req-75b8d806-6f9a-406e-a9ec-f2e86fee90db service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:02.838242 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-3634e10d-20e5-400f-9d35-9b5dfb2c2320 req-75b8d806-6f9a-406e-a9ec-f2e86fee90db service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:02.840172 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Getting quotas for user 9f07caa54c8f47778bb984bfd9800dc0 and project 623b9f3be0f24e2ea1caea0798b30704. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:43:02.849697 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-3634e10d-20e5-400f-9d35-9b5dfb2c2320 req-75b8d806-6f9a-406e-a9ec-f2e86fee90db service nova] Creating event network-changed:3e4ec09b-2a4b-41e0-871c-50fd282365c6 for instance 821737e4-9236-4f80-b1ac-8c4d16c02244 on hv-cinder-85600 Sep 06 04:43:02.857252 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:43:02.857252 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='746b1129-f16e-4823-b9ce-c90ce276f7ba',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:43:02.858065 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-3634e10d-20e5-400f-9d35-9b5dfb2c2320 req-75b8d806-6f9a-406e-a9ec-f2e86fee90db service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030650 Sep 06 04:43:02.858065 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 400/774] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:43:03.023372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0fc2b54c-94b7-4a42-b27c-7e965debc2ff tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670395 Sep 06 04:43:03.024363 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 375/775] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:43:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 04:43:03.035653 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8cb33f94-3226-4fcf-81ed-0c3a9f5d4d94 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:03.036345 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8cb33f94-3226-4fcf-81ed-0c3a9f5d4d94 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:03.091835 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8cb33f94-3226-4fcf-81ed-0c3a9f5d4d94 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:03.098979 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8cb33f94-3226-4fcf-81ed-0c3a9f5d4d94 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1257 microversion: 2.1 time: 0.067797 Sep 06 04:43:03.099543 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 401/776] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:03 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1257 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:03.393039 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c086f1e2-5270-4f63-82e4-90eb99ea5387 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:03.393738 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c086f1e2-5270-4f63-82e4-90eb99ea5387 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:03.401472 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c086f1e2-5270-4f63-82e4-90eb99ea5387 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:03.402199 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c086f1e2-5270-4f63-82e4-90eb99ea5387 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:03.403060 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c086f1e2-5270-4f63-82e4-90eb99ea5387 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:03.403773 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c086f1e2-5270-4f63-82e4-90eb99ea5387 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:03.404433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c086f1e2-5270-4f63-82e4-90eb99ea5387 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:03.405020 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c086f1e2-5270-4f63-82e4-90eb99ea5387 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:03.570923 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c086f1e2-5270-4f63-82e4-90eb99ea5387 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:03.579292 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c086f1e2-5270-4f63-82e4-90eb99ea5387 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1688 microversion: 2.1 time: 0.190271 Sep 06 04:43:03.580282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 376/777] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:03 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:03.637044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c940cfed-77e6-4ee8-9c04-530e246d7abd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:03.637791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c940cfed-77e6-4ee8-9c04-530e246d7abd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:03.645950 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c940cfed-77e6-4ee8-9c04-530e246d7abd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:03.646433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c940cfed-77e6-4ee8-9c04-530e246d7abd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:03.646865 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c940cfed-77e6-4ee8-9c04-530e246d7abd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:03.647587 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c940cfed-77e6-4ee8-9c04-530e246d7abd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:03.648042 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c940cfed-77e6-4ee8-9c04-530e246d7abd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:03.648464 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c940cfed-77e6-4ee8-9c04-530e246d7abd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:03.700961 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:03.810474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c940cfed-77e6-4ee8-9c04-530e246d7abd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:03.819636 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c940cfed-77e6-4ee8-9c04-530e246d7abd tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1453 microversion: 2.1 time: 0.186488 Sep 06 04:43:03.821920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 402/778] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:03 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1453 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:03.848574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-889fb6a2-1be8-43b3-8290-278e0a4d1253 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:03.849179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-889fb6a2-1be8-43b3-8290-278e0a4d1253 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:03.851598 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-745063ea-427f-4685-ab2a-eea03a2c57d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:03.852581 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-745063ea-427f-4685-ab2a-eea03a2c57d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:03.864019 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-745063ea-427f-4685-ab2a-eea03a2c57d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:03.864345 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-889fb6a2-1be8-43b3-8290-278e0a4d1253 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:03.864849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-889fb6a2-1be8-43b3-8290-278e0a4d1253 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:03.865341 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-745063ea-427f-4685-ab2a-eea03a2c57d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:03.865945 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-745063ea-427f-4685-ab2a-eea03a2c57d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:03.866853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-745063ea-427f-4685-ab2a-eea03a2c57d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:03.866955 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-889fb6a2-1be8-43b3-8290-278e0a4d1253 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:03.867114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-745063ea-427f-4685-ab2a-eea03a2c57d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:03.867389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-889fb6a2-1be8-43b3-8290-278e0a4d1253 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:03.867843 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-889fb6a2-1be8-43b3-8290-278e0a4d1253 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:03.868350 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-889fb6a2-1be8-43b3-8290-278e0a4d1253 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:03.868550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-745063ea-427f-4685-ab2a-eea03a2c57d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:04.146753 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-889fb6a2-1be8-43b3-8290-278e0a4d1253 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:04.156236 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-889fb6a2-1be8-43b3-8290-278e0a4d1253 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1453 microversion: 2.1 time: 0.311990 Sep 06 04:43:04.157053 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 377/779] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:03 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1453 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:04.176531 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-55f214cb-f93e-4a31-942b-d4d7c4e6d5f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:04.184555 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-55f214cb-f93e-4a31-942b-d4d7c4e6d5f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:04.271850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-55f214cb-f93e-4a31-942b-d4d7c4e6d5f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:04.282174 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-55f214cb-f93e-4a31-942b-d4d7c4e6d5f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1257 microversion: 2.1 time: 0.116063 Sep 06 04:43:04.294445 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 378/780] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:04 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1257 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:04.381555 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-745063ea-427f-4685-ab2a-eea03a2c57d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:04.398054 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-745063ea-427f-4685-ab2a-eea03a2c57d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:04.398486 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-745063ea-427f-4685-ab2a-eea03a2c57d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:04.399658 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-745063ea-427f-4685-ab2a-eea03a2c57d5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.554218 Sep 06 04:43:04.400832 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 403/781] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:03 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:43:04.604090 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b24a3a64-c84e-4f24-9131-5b55f4856266 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:04.604961 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b24a3a64-c84e-4f24-9131-5b55f4856266 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:04.615008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b24a3a64-c84e-4f24-9131-5b55f4856266 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:04.616011 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b24a3a64-c84e-4f24-9131-5b55f4856266 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:04.616950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b24a3a64-c84e-4f24-9131-5b55f4856266 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:04.617700 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b24a3a64-c84e-4f24-9131-5b55f4856266 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:04.618313 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b24a3a64-c84e-4f24-9131-5b55f4856266 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:04.622434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b24a3a64-c84e-4f24-9131-5b55f4856266 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:04.696380 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b24a3a64-c84e-4f24-9131-5b55f4856266 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:04.704249 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b24a3a64-c84e-4f24-9131-5b55f4856266 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1621 microversion: 2.1 time: 0.104269 Sep 06 04:43:04.706254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 379/782] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:04 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1621 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:04.868564 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-4d1def44-fbbc-4ae8-b58c-f2a653576aaa req-c7a7b110-6e5a-4053-b8be-dde8410840d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4631439d-ba1a-4895-88bc-66f83e93defa", "name": "network-vif-deleted", "tag": "6c3db147-6601-4ab0-a362-ff2c28ef3252"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:04.879277 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-4d1def44-fbbc-4ae8-b58c-f2a653576aaa req-c7a7b110-6e5a-4053-b8be-dde8410840d0 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:04.879747 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-4d1def44-fbbc-4ae8-b58c-f2a653576aaa req-c7a7b110-6e5a-4053-b8be-dde8410840d0 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:04.880171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-4d1def44-fbbc-4ae8-b58c-f2a653576aaa req-c7a7b110-6e5a-4053-b8be-dde8410840d0 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:04.891579 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-4d1def44-fbbc-4ae8-b58c-f2a653576aaa req-c7a7b110-6e5a-4053-b8be-dde8410840d0 service nova] Creating event network-vif-deleted:6c3db147-6601-4ab0-a362-ff2c28ef3252 for instance 4631439d-ba1a-4895-88bc-66f83e93defa on hv-cinder-85600 Sep 06 04:43:04.897612 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-4d1def44-fbbc-4ae8-b58c-f2a653576aaa req-c7a7b110-6e5a-4053-b8be-dde8410840d0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032519 Sep 06 04:43:04.898746 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 404/783] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:43:05.305033 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7340aa05-4b73-4925-8938-bd606ad61b15 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:05.306493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7340aa05-4b73-4925-8938-bd606ad61b15 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:05.315365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7340aa05-4b73-4925-8938-bd606ad61b15 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:05.315869 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7340aa05-4b73-4925-8938-bd606ad61b15 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:05.316309 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7340aa05-4b73-4925-8938-bd606ad61b15 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:05.317020 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7340aa05-4b73-4925-8938-bd606ad61b15 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:05.317511 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7340aa05-4b73-4925-8938-bd606ad61b15 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:05.318049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7340aa05-4b73-4925-8938-bd606ad61b15 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:05.391834 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7340aa05-4b73-4925-8938-bd606ad61b15 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:05.400964 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7340aa05-4b73-4925-8938-bd606ad61b15 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1309 microversion: 2.1 time: 0.099885 Sep 06 04:43:05.405619 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 380/784] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:05 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:43:05.427937 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0bc5dace-714c-41d6-a6ad-d03673dd509d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:05.428624 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0bc5dace-714c-41d6-a6ad-d03673dd509d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:05.434757 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bc5dace-714c-41d6-a6ad-d03673dd509d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:05.435238 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bc5dace-714c-41d6-a6ad-d03673dd509d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:05.435694 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bc5dace-714c-41d6-a6ad-d03673dd509d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:05.436379 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bc5dace-714c-41d6-a6ad-d03673dd509d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:05.436832 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bc5dace-714c-41d6-a6ad-d03673dd509d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:05.437257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0bc5dace-714c-41d6-a6ad-d03673dd509d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:05.631172 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0bc5dace-714c-41d6-a6ad-d03673dd509d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:05.641046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0bc5dace-714c-41d6-a6ad-d03673dd509d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:05.643090 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0bc5dace-714c-41d6-a6ad-d03673dd509d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:05.644764 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0bc5dace-714c-41d6-a6ad-d03673dd509d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.221520 Sep 06 04:43:05.657329 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 405/785] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:05 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:43:05.733398 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-71de05d9-5731-4421-bd9b-3605b8efe433 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:05.734082 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-71de05d9-5731-4421-bd9b-3605b8efe433 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:05.741148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71de05d9-5731-4421-bd9b-3605b8efe433 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:05.741961 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71de05d9-5731-4421-bd9b-3605b8efe433 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:05.742399 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71de05d9-5731-4421-bd9b-3605b8efe433 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:05.743104 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71de05d9-5731-4421-bd9b-3605b8efe433 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:05.743648 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71de05d9-5731-4421-bd9b-3605b8efe433 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:05.744108 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71de05d9-5731-4421-bd9b-3605b8efe433 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:05.808823 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-71de05d9-5731-4421-bd9b-3605b8efe433 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:05.817243 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-71de05d9-5731-4421-bd9b-3605b8efe433 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1330 microversion: 2.1 time: 0.087653 Sep 06 04:43:05.817839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 381/786] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:05 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1330 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:06.425464 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e9f0e73e-ccdf-423c-bd7f-07e6eddd4b78 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:06.426023 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e9f0e73e-ccdf-423c-bd7f-07e6eddd4b78 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:06.432281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9f0e73e-ccdf-423c-bd7f-07e6eddd4b78 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:06.432761 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9f0e73e-ccdf-423c-bd7f-07e6eddd4b78 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:06.433191 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9f0e73e-ccdf-423c-bd7f-07e6eddd4b78 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:06.433895 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9f0e73e-ccdf-423c-bd7f-07e6eddd4b78 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:06.434349 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9f0e73e-ccdf-423c-bd7f-07e6eddd4b78 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:06.434772 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e9f0e73e-ccdf-423c-bd7f-07e6eddd4b78 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:06.495320 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e9f0e73e-ccdf-423c-bd7f-07e6eddd4b78 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:06.503812 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e9f0e73e-ccdf-423c-bd7f-07e6eddd4b78 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1309 microversion: 2.1 time: 0.082743 Sep 06 04:43:06.504381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 406/787] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:06 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1309 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:06.671427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c21d01e3-2821-4516-a3fc-e972d115bd2c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:06.672249 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c21d01e3-2821-4516-a3fc-e972d115bd2c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:06.680373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c21d01e3-2821-4516-a3fc-e972d115bd2c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:06.680373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c21d01e3-2821-4516-a3fc-e972d115bd2c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:06.680983 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c21d01e3-2821-4516-a3fc-e972d115bd2c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:06.682159 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c21d01e3-2821-4516-a3fc-e972d115bd2c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:06.682706 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c21d01e3-2821-4516-a3fc-e972d115bd2c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:06.683232 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c21d01e3-2821-4516-a3fc-e972d115bd2c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:06.826787 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c21d01e3-2821-4516-a3fc-e972d115bd2c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:06.835273 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c21d01e3-2821-4516-a3fc-e972d115bd2c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:06.836826 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c21d01e3-2821-4516-a3fc-e972d115bd2c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:06.838113 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c21d01e3-2821-4516-a3fc-e972d115bd2c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.170837 Sep 06 04:43:06.838757 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 382/788] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:06 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:43:06.840676 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4775465a-b671-44a5-adc9-6cc22cb2443f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:06.841390 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4775465a-b671-44a5-adc9-6cc22cb2443f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:06.848095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4775465a-b671-44a5-adc9-6cc22cb2443f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:06.848584 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4775465a-b671-44a5-adc9-6cc22cb2443f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:06.849024 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4775465a-b671-44a5-adc9-6cc22cb2443f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:06.849768 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4775465a-b671-44a5-adc9-6cc22cb2443f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:06.850226 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4775465a-b671-44a5-adc9-6cc22cb2443f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:06.850652 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4775465a-b671-44a5-adc9-6cc22cb2443f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:06.917413 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-915fd5b1-eabb-4e6e-b867-dc071dbaaa3b req-8cb3ea0e-8626-4c61-808b-32b634f22024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65eefee7-f977-45ba-92a9-d0a97facdad7", "tag": "8a88b191-41e1-4780-8ac2-cac44e992df0"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:06.920506 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4775465a-b671-44a5-adc9-6cc22cb2443f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:06.927605 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-915fd5b1-eabb-4e6e-b867-dc071dbaaa3b req-8cb3ea0e-8626-4c61-808b-32b634f22024 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:06.928086 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-915fd5b1-eabb-4e6e-b867-dc071dbaaa3b req-8cb3ea0e-8626-4c61-808b-32b634f22024 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:06.928519 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-915fd5b1-eabb-4e6e-b867-dc071dbaaa3b req-8cb3ea0e-8626-4c61-808b-32b634f22024 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:06.929237 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4775465a-b671-44a5-adc9-6cc22cb2443f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1330 microversion: 2.1 time: 0.093061 Sep 06 04:43:06.930052 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 407/789] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:06 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:43:06.941479 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-915fd5b1-eabb-4e6e-b867-dc071dbaaa3b req-8cb3ea0e-8626-4c61-808b-32b634f22024 service nova] Creating event network-changed:8a88b191-41e1-4780-8ac2-cac44e992df0 for instance 65eefee7-f977-45ba-92a9-d0a97facdad7 on hv-cinder-85600 Sep 06 04:43:06.946710 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-915fd5b1-eabb-4e6e-b867-dc071dbaaa3b req-8cb3ea0e-8626-4c61-808b-32b634f22024 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033038 Sep 06 04:43:06.948052 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 383/790] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:43:07.527433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6e789062-1439-4319-9f15-7cc2d3a06324 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:07.529947 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6e789062-1439-4319-9f15-7cc2d3a06324 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:07.538036 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e789062-1439-4319-9f15-7cc2d3a06324 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:07.538862 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e789062-1439-4319-9f15-7cc2d3a06324 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:07.539406 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e789062-1439-4319-9f15-7cc2d3a06324 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:07.540325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e789062-1439-4319-9f15-7cc2d3a06324 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:07.540880 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e789062-1439-4319-9f15-7cc2d3a06324 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:07.541559 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e789062-1439-4319-9f15-7cc2d3a06324 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:07.614022 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6e789062-1439-4319-9f15-7cc2d3a06324 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:07.621700 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6e789062-1439-4319-9f15-7cc2d3a06324 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1309 microversion: 2.1 time: 0.098344 Sep 06 04:43:07.622272 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 408/791] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:07 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:07.866243 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-49f974c2-d86f-49e7-aa3e-fdb7c7050ca9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:07.867078 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-49f974c2-d86f-49e7-aa3e-fdb7c7050ca9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:07.873544 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49f974c2-d86f-49e7-aa3e-fdb7c7050ca9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:07.874205 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49f974c2-d86f-49e7-aa3e-fdb7c7050ca9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:07.874700 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49f974c2-d86f-49e7-aa3e-fdb7c7050ca9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:07.875630 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49f974c2-d86f-49e7-aa3e-fdb7c7050ca9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:07.876945 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49f974c2-d86f-49e7-aa3e-fdb7c7050ca9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:07.877654 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-49f974c2-d86f-49e7-aa3e-fdb7c7050ca9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:07.964357 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e7e637bb-bec5-40e4-90f0-68c2fae1b9fa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:07.965012 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e7e637bb-bec5-40e4-90f0-68c2fae1b9fa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:07.972475 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e7e637bb-bec5-40e4-90f0-68c2fae1b9fa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:07.975727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e7e637bb-bec5-40e4-90f0-68c2fae1b9fa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:07.975727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e7e637bb-bec5-40e4-90f0-68c2fae1b9fa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:07.975727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e7e637bb-bec5-40e4-90f0-68c2fae1b9fa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:07.975727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e7e637bb-bec5-40e4-90f0-68c2fae1b9fa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:07.978368 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e7e637bb-bec5-40e4-90f0-68c2fae1b9fa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:08.007330 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e7e637bb-bec5-40e4-90f0-68c2fae1b9fa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:08.007810 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e7e637bb-bec5-40e4-90f0-68c2fae1b9fa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:08.008246 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e7e637bb-bec5-40e4-90f0-68c2fae1b9fa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:08.008691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-e7e637bb-bec5-40e4-90f0-68c2fae1b9fa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lazy-loading 'fault' on Instance uuid 4631439d-ba1a-4895-88bc-66f83e93defa {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:43:08.032469 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-49f974c2-d86f-49e7-aa3e-fdb7c7050ca9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:08.041609 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-49f974c2-d86f-49e7-aa3e-fdb7c7050ca9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:08.043165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-49f974c2-d86f-49e7-aa3e-fdb7c7050ca9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:08.044519 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-49f974c2-d86f-49e7-aa3e-fdb7c7050ca9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.184881 Sep 06 04:43:08.045180 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 384/792] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:07 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:43:08.051371 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e7e637bb-bec5-40e4-90f0-68c2fae1b9fa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:08.059495 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e7e637bb-bec5-40e4-90f0-68c2fae1b9fa tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 200 len: 1335 microversion: 2.1 time: 0.102909 Sep 06 04:43:08.060060 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 409/793] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:07 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 1335 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:43:08.644303 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d11b3032-c8cf-488f-8734-b00e127f095f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:08.645444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d11b3032-c8cf-488f-8734-b00e127f095f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:08.651560 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d11b3032-c8cf-488f-8734-b00e127f095f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:08.652051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d11b3032-c8cf-488f-8734-b00e127f095f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:08.652775 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d11b3032-c8cf-488f-8734-b00e127f095f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:08.653764 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d11b3032-c8cf-488f-8734-b00e127f095f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:08.654222 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d11b3032-c8cf-488f-8734-b00e127f095f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:08.654648 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d11b3032-c8cf-488f-8734-b00e127f095f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:08.721819 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d11b3032-c8cf-488f-8734-b00e127f095f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:08.729816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d11b3032-c8cf-488f-8734-b00e127f095f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1327 microversion: 2.1 time: 0.089453 Sep 06 04:43:08.730394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 385/794] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:08 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1327 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:09.072420 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8378f425-d5c9-4712-b86d-578850627489 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:09.073262 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8378f425-d5c9-4712-b86d-578850627489 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:09.081364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8378f425-d5c9-4712-b86d-578850627489 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:09.083560 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8378f425-d5c9-4712-b86d-578850627489 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:09.084149 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8378f425-d5c9-4712-b86d-578850627489 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:09.084952 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8378f425-d5c9-4712-b86d-578850627489 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:09.085557 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8378f425-d5c9-4712-b86d-578850627489 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:09.086076 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8378f425-d5c9-4712-b86d-578850627489 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:09.092512 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-07fefe3c-7b10-46ac-a013-26c5773c05d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:09.092512 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-07fefe3c-7b10-46ac-a013-26c5773c05d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: 4631439d-ba1a-4895-88bc-66f83e93defa] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:09.099091 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07fefe3c-7b10-46ac-a013-26c5773c05d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:09.099587 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07fefe3c-7b10-46ac-a013-26c5773c05d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:09.100019 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07fefe3c-7b10-46ac-a013-26c5773c05d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:09.100719 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07fefe3c-7b10-46ac-a013-26c5773c05d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:09.101173 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07fefe3c-7b10-46ac-a013-26c5773c05d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:09.101632 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-07fefe3c-7b10-46ac-a013-26c5773c05d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:09.124792 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-07fefe3c-7b10-46ac-a013-26c5773c05d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] HTTP exception thrown: Instance 4631439d-ba1a-4895-88bc-66f83e93defa could not be found. Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-07fefe3c-7b10-46ac-a013-26c5773c05d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Request method failure captured: Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa HTTP/1.1 Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4ShSrtmqUjFGUKG962wNt7LkzYM3H0fxdZ4mdnzTKicnH2a1pwDbv7dv5CWGNDm2D2-tqaRREzJYjQqF33RYhMiNEgLbULGTL6P0__4bHirkaw0M3xA0fCopVUzt_zEi1at48QcuQnfkdAMrCCuCfH2J4_6gox-co2Z-Cq2ue1hT0 Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 7aa4ca550edd4876a4c6c56deedf9d70 Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1362344250 Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:43:09.126533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:43:09.128157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:43:09.128157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1362344250 Sep 06 04:43:09.128157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 7aa4ca550edd4876a4c6c56deedf9d70 Sep 06 04:43:09.128157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1362344250 Sep 06 04:43:09.128157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-ServerRescueNegativeTestJSON-1362344250-project Sep 06 04:43:09.128157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:43:09.128157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:43:09.128157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: dec1c17550b849dbadbc16e98530b455 Sep 06 04:43:09.128157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1362344250-project Sep 06 04:43:09.128157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:43:09.128157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 4631439d-ba1a-4895-88bc-66f83e93defa could not be found. Sep 06 04:43:09.128157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '4631439d-ba1a-4895-88bc-66f83e93defa'} Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4631439d-ba1a-4895-88bc-66f83e93defa could not be found. Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:43:09.129077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4631439d-ba1a-4895-88bc-66f83e93defa could not be found. Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4631439d-ba1a-4895-88bc-66f83e93defa could not be found. Sep 06 04:43:09.130389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:43:09.131468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-07fefe3c-7b10-46ac-a013-26c5773c05d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Returning 404 to user: Instance 4631439d-ba1a-4895-88bc-66f83e93defa could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:43:09.131468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-07fefe3c-7b10-46ac-a013-26c5773c05d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa" status: 404 len: 111 microversion: 2.1 time: 0.043136 Sep 06 04:43:09.131468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 386/795] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:09 2022] GET /compute/v2.1/servers/4631439d-ba1a-4895-88bc-66f83e93defa => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 04:43:09.150021 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-900e2868-dcc0-4405-9672-d801ea2910a3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '.version_select at 0x7f31763a9040>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:09.262749 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-900e2868-dcc0-4405-9672-d801ea2910a3 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089788396" status: 202 len: 0 microversion: 2.1 time: 0.122132 Sep 06 04:43:09.263440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 387/796] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Sep 6 04:43:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2089788396 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:43:09.300407 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8378f425-d5c9-4712-b86d-578850627489 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:09.311996 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8378f425-d5c9-4712-b86d-578850627489 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:09.316255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8378f425-d5c9-4712-b86d-578850627489 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:09.324186 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8378f425-d5c9-4712-b86d-578850627489 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.249325 Sep 06 04:43:09.324186 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 410/797] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:09 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:43:09.753253 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5f7187bf-4dbd-434d-be12-d375aedaf959 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:09.754190 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5f7187bf-4dbd-434d-be12-d375aedaf959 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:09.771165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f7187bf-4dbd-434d-be12-d375aedaf959 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:09.772273 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f7187bf-4dbd-434d-be12-d375aedaf959 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:09.772887 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f7187bf-4dbd-434d-be12-d375aedaf959 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:09.773871 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f7187bf-4dbd-434d-be12-d375aedaf959 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:09.774490 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f7187bf-4dbd-434d-be12-d375aedaf959 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:09.775664 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f7187bf-4dbd-434d-be12-d375aedaf959 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:09.980192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5f7187bf-4dbd-434d-be12-d375aedaf959 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:09.991811 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5f7187bf-4dbd-434d-be12-d375aedaf959 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.242721 Sep 06 04:43:09.993201 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 388/798] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:09 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:10.035609 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-96c5507d-29e8-496b-b1bb-57077b319f40 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:10.036706 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-96c5507d-29e8-496b-b1bb-57077b319f40 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:10.054013 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-96c5507d-29e8-496b-b1bb-57077b319f40 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:10.055559 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-96c5507d-29e8-496b-b1bb-57077b319f40 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:10.062230 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-96c5507d-29e8-496b-b1bb-57077b319f40 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:10.063318 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-96c5507d-29e8-496b-b1bb-57077b319f40 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:10.064664 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-96c5507d-29e8-496b-b1bb-57077b319f40 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:10.065286 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-96c5507d-29e8-496b-b1bb-57077b319f40 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:10.117032 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-96c5507d-29e8-496b-b1bb-57077b319f40 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lazy-loading 'flavor' on Instance uuid ddad572e-12e1-4699-ba46-16c1ccb25704 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:43:10.272876 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:10.343350 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a9a5c110-6926-44d3-86c9-c398cb066732 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:10.344715 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a9a5c110-6926-44d3-86c9-c398cb066732 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:10.359913 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9a5c110-6926-44d3-86c9-c398cb066732 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:10.370793 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9a5c110-6926-44d3-86c9-c398cb066732 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:10.372816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9a5c110-6926-44d3-86c9-c398cb066732 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:10.373921 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9a5c110-6926-44d3-86c9-c398cb066732 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:10.378678 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9a5c110-6926-44d3-86c9-c398cb066732 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:10.386115 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a9a5c110-6926-44d3-86c9-c398cb066732 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:10.497081 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-96c5507d-29e8-496b-b1bb-57077b319f40 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "POST /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704/action" status: 202 len: 0 microversion: 2.1 time: 0.469065 Sep 06 04:43:10.503016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 411/799] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Sep 6 04:43:10 2022] POST /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:43:10.509855 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f84836c4-928a-41f7-8ef7-d8c097313468 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:10.510875 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f84836c4-928a-41f7-8ef7-d8c097313468 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:10.518476 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f84836c4-928a-41f7-8ef7-d8c097313468 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:10.519727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f84836c4-928a-41f7-8ef7-d8c097313468 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:10.520024 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f84836c4-928a-41f7-8ef7-d8c097313468 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:10.520939 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f84836c4-928a-41f7-8ef7-d8c097313468 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:10.521694 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f84836c4-928a-41f7-8ef7-d8c097313468 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:10.522307 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f84836c4-928a-41f7-8ef7-d8c097313468 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:10.708716 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f84836c4-928a-41f7-8ef7-d8c097313468 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:10.718404 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f84836c4-928a-41f7-8ef7-d8c097313468 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.213240 Sep 06 04:43:10.720277 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 412/800] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:10 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:10.744275 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a9a5c110-6926-44d3-86c9-c398cb066732 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:10.755824 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a9a5c110-6926-44d3-86c9-c398cb066732 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:10.759060 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a9a5c110-6926-44d3-86c9-c398cb066732 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:10.761191 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a9a5c110-6926-44d3-86c9-c398cb066732 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.422481 Sep 06 04:43:10.776138 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 389/801] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:10 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:43:10.779501 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-ef1d7778-4286-41ce-8ab2-51a57dfe9760 req-bf8ea757-957d-4778-b5af-4caed3192aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6c1b505-babf-4fde-b18b-7d72d9cc0acc", "tag": "2a57860e-e2d2-4ede-943c-6db28a3cdf5a"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:10.790499 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ef1d7778-4286-41ce-8ab2-51a57dfe9760 req-bf8ea757-957d-4778-b5af-4caed3192aa5 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:10.790991 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ef1d7778-4286-41ce-8ab2-51a57dfe9760 req-bf8ea757-957d-4778-b5af-4caed3192aa5 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:10.791571 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ef1d7778-4286-41ce-8ab2-51a57dfe9760 req-bf8ea757-957d-4778-b5af-4caed3192aa5 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:10.812225 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-ef1d7778-4286-41ce-8ab2-51a57dfe9760 req-bf8ea757-957d-4778-b5af-4caed3192aa5 service nova] Creating event network-changed:2a57860e-e2d2-4ede-943c-6db28a3cdf5a for instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc on hv-cinder-85600 Sep 06 04:43:10.821423 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-ef1d7778-4286-41ce-8ab2-51a57dfe9760 req-bf8ea757-957d-4778-b5af-4caed3192aa5 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045274 Sep 06 04:43:10.824330 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 413/802] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:43:11.020271 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bed0f876-f55d-4089-960e-8e1618eac762 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:11.021521 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bed0f876-f55d-4089-960e-8e1618eac762 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:11.029410 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bed0f876-f55d-4089-960e-8e1618eac762 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:11.029908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bed0f876-f55d-4089-960e-8e1618eac762 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:11.030347 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bed0f876-f55d-4089-960e-8e1618eac762 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:11.031471 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bed0f876-f55d-4089-960e-8e1618eac762 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:11.031936 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bed0f876-f55d-4089-960e-8e1618eac762 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:11.032588 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bed0f876-f55d-4089-960e-8e1618eac762 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:11.198240 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bed0f876-f55d-4089-960e-8e1618eac762 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:11.212830 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bed0f876-f55d-4089-960e-8e1618eac762 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.195893 Sep 06 04:43:11.213457 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 390/803] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:11 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:11.748451 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0c99fd86-a81e-47d1-a11a-af2637cb3c22 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:11.749905 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0c99fd86-a81e-47d1-a11a-af2637cb3c22 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:11.757243 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c99fd86-a81e-47d1-a11a-af2637cb3c22 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:11.757909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c99fd86-a81e-47d1-a11a-af2637cb3c22 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:11.758387 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c99fd86-a81e-47d1-a11a-af2637cb3c22 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:11.759090 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c99fd86-a81e-47d1-a11a-af2637cb3c22 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:11.759546 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c99fd86-a81e-47d1-a11a-af2637cb3c22 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:11.759996 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0c99fd86-a81e-47d1-a11a-af2637cb3c22 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:11.795367 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-505d40da-3522-4050-8c66-e8ef7bbf3ce6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:11.799823 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-505d40da-3522-4050-8c66-e8ef7bbf3ce6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:11.810316 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-505d40da-3522-4050-8c66-e8ef7bbf3ce6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:11.810886 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-505d40da-3522-4050-8c66-e8ef7bbf3ce6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:11.811486 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-505d40da-3522-4050-8c66-e8ef7bbf3ce6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:11.812331 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-505d40da-3522-4050-8c66-e8ef7bbf3ce6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:11.813182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-505d40da-3522-4050-8c66-e8ef7bbf3ce6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:11.813414 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-505d40da-3522-4050-8c66-e8ef7bbf3ce6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:11.957661 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0c99fd86-a81e-47d1-a11a-af2637cb3c22 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:11.975599 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0c99fd86-a81e-47d1-a11a-af2637cb3c22 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.230978 Sep 06 04:43:11.977033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 414/804] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:11 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:12.000605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-5a1538c9-e123-4ba3-a15f-8f351b3d11b4 req-4fec664a-cdad-4ad1-b06e-beb8ddbae6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821737e4-9236-4f80-b1ac-8c4d16c02244", "name": "network-vif-plugged", "status": "completed", "tag": "3e4ec09b-2a4b-41e0-871c-50fd282365c6"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:12.018147 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-5a1538c9-e123-4ba3-a15f-8f351b3d11b4 req-4fec664a-cdad-4ad1-b06e-beb8ddbae6d6 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:12.018648 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-5a1538c9-e123-4ba3-a15f-8f351b3d11b4 req-4fec664a-cdad-4ad1-b06e-beb8ddbae6d6 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:12.019068 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-5a1538c9-e123-4ba3-a15f-8f351b3d11b4 req-4fec664a-cdad-4ad1-b06e-beb8ddbae6d6 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:12.034459 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-505d40da-3522-4050-8c66-e8ef7bbf3ce6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:12.034637 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-5a1538c9-e123-4ba3-a15f-8f351b3d11b4 req-4fec664a-cdad-4ad1-b06e-beb8ddbae6d6 service nova] Creating event network-vif-plugged:3e4ec09b-2a4b-41e0-871c-50fd282365c6 for instance 821737e4-9236-4f80-b1ac-8c4d16c02244 on hv-cinder-85600 Sep 06 04:43:12.039872 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-5a1538c9-e123-4ba3-a15f-8f351b3d11b4 req-4fec664a-cdad-4ad1-b06e-beb8ddbae6d6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042790 Sep 06 04:43:12.040620 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 415/805] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:43:12.050724 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-505d40da-3522-4050-8c66-e8ef7bbf3ce6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:12.052173 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-505d40da-3522-4050-8c66-e8ef7bbf3ce6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:12.053380 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-505d40da-3522-4050-8c66-e8ef7bbf3ce6 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.265450 Sep 06 04:43:12.053940 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 391/806] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:11 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:43:12.238250 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-540e0039-d90b-4db0-9cbc-cbd12b159226 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:12.238866 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-540e0039-d90b-4db0-9cbc-cbd12b159226 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:12.246607 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540e0039-d90b-4db0-9cbc-cbd12b159226 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:12.247103 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540e0039-d90b-4db0-9cbc-cbd12b159226 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:12.247542 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540e0039-d90b-4db0-9cbc-cbd12b159226 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:12.248247 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540e0039-d90b-4db0-9cbc-cbd12b159226 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:12.248735 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540e0039-d90b-4db0-9cbc-cbd12b159226 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:12.249131 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-540e0039-d90b-4db0-9cbc-cbd12b159226 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:12.405359 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-540e0039-d90b-4db0-9cbc-cbd12b159226 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:12.414155 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-540e0039-d90b-4db0-9cbc-cbd12b159226 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.180729 Sep 06 04:43:12.415280 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 416/807] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:12 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:12.999607 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cfd7d918-da40-45b2-9432-7d23a179612a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:13.000243 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cfd7d918-da40-45b2-9432-7d23a179612a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:13.003596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:13.009286 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cfd7d918-da40-45b2-9432-7d23a179612a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:13.009851 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cfd7d918-da40-45b2-9432-7d23a179612a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:13.010448 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cfd7d918-da40-45b2-9432-7d23a179612a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:13.011149 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cfd7d918-da40-45b2-9432-7d23a179612a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:13.011596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cfd7d918-da40-45b2-9432-7d23a179612a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:13.012013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cfd7d918-da40-45b2-9432-7d23a179612a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:13.034644 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:13.083532 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8cd3adcd-c638-41f9-aa03-9d9865ec3b85 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:13.084146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8cd3adcd-c638-41f9-aa03-9d9865ec3b85 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:13.090936 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cd3adcd-c638-41f9-aa03-9d9865ec3b85 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:13.091425 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cd3adcd-c638-41f9-aa03-9d9865ec3b85 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:13.091859 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cd3adcd-c638-41f9-aa03-9d9865ec3b85 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:13.092578 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cd3adcd-c638-41f9-aa03-9d9865ec3b85 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:13.093021 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cd3adcd-c638-41f9-aa03-9d9865ec3b85 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:13.093471 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cd3adcd-c638-41f9-aa03-9d9865ec3b85 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:13.112339 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=8 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:13.179141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cfd7d918-da40-45b2-9432-7d23a179612a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:13.188573 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cfd7d918-da40-45b2-9432-7d23a179612a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.192936 Sep 06 04:43:13.189490 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 392/808] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:12 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:13.270064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8cd3adcd-c638-41f9-aa03-9d9865ec3b85 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:13.281400 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8cd3adcd-c638-41f9-aa03-9d9865ec3b85 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:13.283545 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8cd3adcd-c638-41f9-aa03-9d9865ec3b85 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:13.285050 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8cd3adcd-c638-41f9-aa03-9d9865ec3b85 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.205566 Sep 06 04:43:13.285783 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 417/809] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:13 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:43:13.440084 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a2259649-90f2-48ad-8995-d254b9b2d811 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:13.440695 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a2259649-90f2-48ad-8995-d254b9b2d811 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:13.446905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2259649-90f2-48ad-8995-d254b9b2d811 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:13.447398 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2259649-90f2-48ad-8995-d254b9b2d811 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:13.447831 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2259649-90f2-48ad-8995-d254b9b2d811 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:13.448530 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2259649-90f2-48ad-8995-d254b9b2d811 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:13.448988 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2259649-90f2-48ad-8995-d254b9b2d811 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:13.449452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a2259649-90f2-48ad-8995-d254b9b2d811 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:13.557915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cb1f270a-f453-408e-b21d-3be93d88c656 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:13.558828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cb1f270a-f453-408e-b21d-3be93d88c656 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:13.566953 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb1f270a-f453-408e-b21d-3be93d88c656 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:13.567441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb1f270a-f453-408e-b21d-3be93d88c656 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:13.567877 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb1f270a-f453-408e-b21d-3be93d88c656 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:13.568567 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb1f270a-f453-408e-b21d-3be93d88c656 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:13.569020 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb1f270a-f453-408e-b21d-3be93d88c656 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:13.569503 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb1f270a-f453-408e-b21d-3be93d88c656 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:13.593649 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a2259649-90f2-48ad-8995-d254b9b2d811 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:13.601012 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cb1f270a-f453-408e-b21d-3be93d88c656 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:43:13.609889 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a2259649-90f2-48ad-8995-d254b9b2d811 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.173602 Sep 06 04:43:13.611213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 393/810] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:13 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:43:13.896074 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cb1f270a-f453-408e-b21d-3be93d88c656 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 204 len: 0 microversion: 2.1 time: 0.341478 Sep 06 04:43:13.896771 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 418/811] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:43:13 2022] DELETE /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 04:43:13.905275 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-44497b11-ecdb-4f64-97c3-ff0286eac3d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:13.906097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-44497b11-ecdb-4f64-97c3-ff0286eac3d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:13.912787 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44497b11-ecdb-4f64-97c3-ff0286eac3d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:13.913277 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44497b11-ecdb-4f64-97c3-ff0286eac3d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:13.913745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44497b11-ecdb-4f64-97c3-ff0286eac3d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:13.914447 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44497b11-ecdb-4f64-97c3-ff0286eac3d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:13.915066 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44497b11-ecdb-4f64-97c3-ff0286eac3d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:13.915491 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-44497b11-ecdb-4f64-97c3-ff0286eac3d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:14.063489 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-44497b11-ecdb-4f64-97c3-ff0286eac3d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:14.063489 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-44497b11-ecdb-4f64-97c3-ff0286eac3d6 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1507 microversion: 2.1 time: 0.160525 Sep 06 04:43:14.063489 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 394/812] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:13 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:14.212948 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bb5f4ae1-acb8-4530-914c-76fc700c4967 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:14.213611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bb5f4ae1-acb8-4530-914c-76fc700c4967 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:14.220156 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb5f4ae1-acb8-4530-914c-76fc700c4967 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:14.224471 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb5f4ae1-acb8-4530-914c-76fc700c4967 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:14.224471 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb5f4ae1-acb8-4530-914c-76fc700c4967 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:14.224471 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb5f4ae1-acb8-4530-914c-76fc700c4967 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:14.224471 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb5f4ae1-acb8-4530-914c-76fc700c4967 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:14.224868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb5f4ae1-acb8-4530-914c-76fc700c4967 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:14.310554 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3a96b69b-40e3-459d-a116-9923216b3db4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:14.311155 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3a96b69b-40e3-459d-a116-9923216b3db4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:14.313194 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=18 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:14.318869 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a96b69b-40e3-459d-a116-9923216b3db4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:14.319347 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a96b69b-40e3-459d-a116-9923216b3db4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:14.319775 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a96b69b-40e3-459d-a116-9923216b3db4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:14.320454 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a96b69b-40e3-459d-a116-9923216b3db4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:14.320898 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a96b69b-40e3-459d-a116-9923216b3db4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:14.321388 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a96b69b-40e3-459d-a116-9923216b3db4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:14.370637 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bb5f4ae1-acb8-4530-914c-76fc700c4967 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:14.381696 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bb5f4ae1-acb8-4530-914c-76fc700c4967 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.172609 Sep 06 04:43:14.382863 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 419/813] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:14 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:14.473836 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3a96b69b-40e3-459d-a116-9923216b3db4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:14.482544 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3a96b69b-40e3-459d-a116-9923216b3db4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:14.487140 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3a96b69b-40e3-459d-a116-9923216b3db4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:14.487140 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3a96b69b-40e3-459d-a116-9923216b3db4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.178427 Sep 06 04:43:14.487140 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 395/814] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:14 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:43:14.634068 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-86947b55-30a8-44bf-946c-d515c98035aa tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:14.635003 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-86947b55-30a8-44bf-946c-d515c98035aa tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:14.641326 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-86947b55-30a8-44bf-946c-d515c98035aa tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:14.641855 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-86947b55-30a8-44bf-946c-d515c98035aa tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:14.642292 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-86947b55-30a8-44bf-946c-d515c98035aa tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:14.643270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-86947b55-30a8-44bf-946c-d515c98035aa tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:14.643770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-86947b55-30a8-44bf-946c-d515c98035aa tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:14.644194 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-86947b55-30a8-44bf-946c-d515c98035aa tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:14.790272 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-86947b55-30a8-44bf-946c-d515c98035aa tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:14.799066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-86947b55-30a8-44bf-946c-d515c98035aa tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.168012 Sep 06 04:43:14.799935 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 420/815] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:14 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:15.088494 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-40246df6-1943-41ac-8e5b-5318c2c0b8c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:15.090212 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-40246df6-1943-41ac-8e5b-5318c2c0b8c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:15.098586 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40246df6-1943-41ac-8e5b-5318c2c0b8c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:15.099165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40246df6-1943-41ac-8e5b-5318c2c0b8c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:15.099603 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40246df6-1943-41ac-8e5b-5318c2c0b8c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:15.100294 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40246df6-1943-41ac-8e5b-5318c2c0b8c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:15.100739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40246df6-1943-41ac-8e5b-5318c2c0b8c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:15.101150 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-40246df6-1943-41ac-8e5b-5318c2c0b8c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:15.243123 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-40246df6-1943-41ac-8e5b-5318c2c0b8c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:15.251014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-40246df6-1943-41ac-8e5b-5318c2c0b8c1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1507 microversion: 2.1 time: 0.168559 Sep 06 04:43:15.252266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 396/816] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:15 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:15.407242 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3e503563-f6ec-4121-a012-a03913c284f3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:15.409021 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3e503563-f6ec-4121-a012-a03913c284f3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:15.416039 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e503563-f6ec-4121-a012-a03913c284f3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:15.416476 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e503563-f6ec-4121-a012-a03913c284f3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:15.416917 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e503563-f6ec-4121-a012-a03913c284f3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:15.417693 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e503563-f6ec-4121-a012-a03913c284f3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:15.418154 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e503563-f6ec-4121-a012-a03913c284f3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:15.418579 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e503563-f6ec-4121-a012-a03913c284f3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:15.511550 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7213eaa5-d5e7-411b-b593-9886bbf48382 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:15.512504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7213eaa5-d5e7-411b-b593-9886bbf48382 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:15.519999 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7213eaa5-d5e7-411b-b593-9886bbf48382 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:15.520576 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7213eaa5-d5e7-411b-b593-9886bbf48382 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:15.523735 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7213eaa5-d5e7-411b-b593-9886bbf48382 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:15.524752 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7213eaa5-d5e7-411b-b593-9886bbf48382 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:15.525275 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7213eaa5-d5e7-411b-b593-9886bbf48382 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:15.525803 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7213eaa5-d5e7-411b-b593-9886bbf48382 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:15.582547 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3e503563-f6ec-4121-a012-a03913c284f3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:15.599347 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3e503563-f6ec-4121-a012-a03913c284f3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.191792 Sep 06 04:43:15.599347 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 421/817] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:15 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:15.693826 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7213eaa5-d5e7-411b-b593-9886bbf48382 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:15.704921 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7213eaa5-d5e7-411b-b593-9886bbf48382 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:15.706525 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7213eaa5-d5e7-411b-b593-9886bbf48382 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:15.707791 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7213eaa5-d5e7-411b-b593-9886bbf48382 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.200763 Sep 06 04:43:15.708366 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 397/818] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:15 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:43:15.822630 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-61bb12b3-6604-484f-b161-895f47489d7b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:15.823236 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-61bb12b3-6604-484f-b161-895f47489d7b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:15.829989 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61bb12b3-6604-484f-b161-895f47489d7b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:15.830480 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61bb12b3-6604-484f-b161-895f47489d7b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:15.830923 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61bb12b3-6604-484f-b161-895f47489d7b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:15.831617 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61bb12b3-6604-484f-b161-895f47489d7b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:15.832062 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61bb12b3-6604-484f-b161-895f47489d7b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:15.832477 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61bb12b3-6604-484f-b161-895f47489d7b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:15.984252 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-61bb12b3-6604-484f-b161-895f47489d7b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:15.994056 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-61bb12b3-6604-484f-b161-895f47489d7b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.175075 Sep 06 04:43:15.994612 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 422/819] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:15 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:16.277011 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bc23bfb8-9b33-40ae-9fdc-f9a9db728991 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:16.278876 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bc23bfb8-9b33-40ae-9fdc-f9a9db728991 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:16.286361 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bc23bfb8-9b33-40ae-9fdc-f9a9db728991 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:16.287130 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bc23bfb8-9b33-40ae-9fdc-f9a9db728991 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:16.287565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bc23bfb8-9b33-40ae-9fdc-f9a9db728991 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:16.288411 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bc23bfb8-9b33-40ae-9fdc-f9a9db728991 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:16.288911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bc23bfb8-9b33-40ae-9fdc-f9a9db728991 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:16.289276 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bc23bfb8-9b33-40ae-9fdc-f9a9db728991 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:16.447129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bc23bfb8-9b33-40ae-9fdc-f9a9db728991 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:16.455935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bc23bfb8-9b33-40ae-9fdc-f9a9db728991 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1507 microversion: 2.1 time: 0.183220 Sep 06 04:43:16.456535 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 398/820] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:16 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:16.620324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-07839d36-3b19-472b-ae23-43fde915000f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:16.620991 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-07839d36-3b19-472b-ae23-43fde915000f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:16.627877 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07839d36-3b19-472b-ae23-43fde915000f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:16.628371 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07839d36-3b19-472b-ae23-43fde915000f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:16.628812 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07839d36-3b19-472b-ae23-43fde915000f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:16.629596 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07839d36-3b19-472b-ae23-43fde915000f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:16.630103 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07839d36-3b19-472b-ae23-43fde915000f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:16.632606 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07839d36-3b19-472b-ae23-43fde915000f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:16.734974 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-452df92a-d352-439f-935a-f8b95cb2ab11 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:16.737117 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-452df92a-d352-439f-935a-f8b95cb2ab11 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:16.748535 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-452df92a-d352-439f-935a-f8b95cb2ab11 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:16.749138 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-452df92a-d352-439f-935a-f8b95cb2ab11 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:16.749764 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-452df92a-d352-439f-935a-f8b95cb2ab11 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:16.750566 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-452df92a-d352-439f-935a-f8b95cb2ab11 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:16.751849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-452df92a-d352-439f-935a-f8b95cb2ab11 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:16.752270 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-452df92a-d352-439f-935a-f8b95cb2ab11 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:16.817970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-07839d36-3b19-472b-ae23-43fde915000f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:16.829115 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-07839d36-3b19-472b-ae23-43fde915000f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.212500 Sep 06 04:43:16.845926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 423/821] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:16 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:16.962253 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-452df92a-d352-439f-935a-f8b95cb2ab11 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:16.962253 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-452df92a-d352-439f-935a-f8b95cb2ab11 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:16.962493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-452df92a-d352-439f-935a-f8b95cb2ab11 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:16.962493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-452df92a-d352-439f-935a-f8b95cb2ab11 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.186852 Sep 06 04:43:16.962493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 399/822] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:16 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:43:17.020572 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4162e537-d414-44ce-b71c-bd2961f631d7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:17.021197 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4162e537-d414-44ce-b71c-bd2961f631d7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:17.029553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4162e537-d414-44ce-b71c-bd2961f631d7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:17.030053 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4162e537-d414-44ce-b71c-bd2961f631d7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:17.030498 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4162e537-d414-44ce-b71c-bd2961f631d7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:17.031211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4162e537-d414-44ce-b71c-bd2961f631d7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:17.031667 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4162e537-d414-44ce-b71c-bd2961f631d7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:17.032090 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4162e537-d414-44ce-b71c-bd2961f631d7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:17.200832 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4162e537-d414-44ce-b71c-bd2961f631d7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:17.216218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4162e537-d414-44ce-b71c-bd2961f631d7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.195775 Sep 06 04:43:17.216218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 424/823] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:17 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:17.481058 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8ee2544f-b50f-434e-b543-2e5a2f52290f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:17.481745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8ee2544f-b50f-434e-b543-2e5a2f52290f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:17.488815 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ee2544f-b50f-434e-b543-2e5a2f52290f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:17.489337 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ee2544f-b50f-434e-b543-2e5a2f52290f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:17.489996 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ee2544f-b50f-434e-b543-2e5a2f52290f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:17.490698 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ee2544f-b50f-434e-b543-2e5a2f52290f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:17.491152 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ee2544f-b50f-434e-b543-2e5a2f52290f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:17.491602 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8ee2544f-b50f-434e-b543-2e5a2f52290f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:17.631832 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8ee2544f-b50f-434e-b543-2e5a2f52290f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:17.639849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8ee2544f-b50f-434e-b543-2e5a2f52290f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1507 microversion: 2.1 time: 0.163257 Sep 06 04:43:17.643832 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 400/824] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:17 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:17.854308 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-328d57c7-f17f-4027-8f0c-e64ca8c397f1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:17.855237 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-328d57c7-f17f-4027-8f0c-e64ca8c397f1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:17.869624 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-328d57c7-f17f-4027-8f0c-e64ca8c397f1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:17.870124 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-328d57c7-f17f-4027-8f0c-e64ca8c397f1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:17.870551 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-328d57c7-f17f-4027-8f0c-e64ca8c397f1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:17.871232 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-328d57c7-f17f-4027-8f0c-e64ca8c397f1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:17.871682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-328d57c7-f17f-4027-8f0c-e64ca8c397f1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:17.872097 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-328d57c7-f17f-4027-8f0c-e64ca8c397f1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:17.990277 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-267e0980-2795-4258-83b6-3e6ae5844ce5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:17.990991 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-267e0980-2795-4258-83b6-3e6ae5844ce5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:17.997377 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267e0980-2795-4258-83b6-3e6ae5844ce5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:17.997936 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267e0980-2795-4258-83b6-3e6ae5844ce5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:17.998435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267e0980-2795-4258-83b6-3e6ae5844ce5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:17.999193 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267e0980-2795-4258-83b6-3e6ae5844ce5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:17.999706 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267e0980-2795-4258-83b6-3e6ae5844ce5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:18.000192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-267e0980-2795-4258-83b6-3e6ae5844ce5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:18.019814 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-328d57c7-f17f-4027-8f0c-e64ca8c397f1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:18.028529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-328d57c7-f17f-4027-8f0c-e64ca8c397f1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.178596 Sep 06 04:43:18.045673 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 425/825] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:17 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:18.155084 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-267e0980-2795-4258-83b6-3e6ae5844ce5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:18.163926 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-267e0980-2795-4258-83b6-3e6ae5844ce5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:18.165450 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-267e0980-2795-4258-83b6-3e6ae5844ce5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:18.166577 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-267e0980-2795-4258-83b6-3e6ae5844ce5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.180150 Sep 06 04:43:18.167134 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 401/826] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:17 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:43:18.236174 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-76a1423c-455b-4f63-b484-0e80698499a9 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:18.236794 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-76a1423c-455b-4f63-b484-0e80698499a9 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:18.242843 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-76a1423c-455b-4f63-b484-0e80698499a9 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:18.243341 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-76a1423c-455b-4f63-b484-0e80698499a9 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:18.243783 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-76a1423c-455b-4f63-b484-0e80698499a9 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:18.244483 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-76a1423c-455b-4f63-b484-0e80698499a9 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:18.244942 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-76a1423c-455b-4f63-b484-0e80698499a9 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:18.245394 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-76a1423c-455b-4f63-b484-0e80698499a9 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:18.391727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-76a1423c-455b-4f63-b484-0e80698499a9 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:18.401071 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-76a1423c-455b-4f63-b484-0e80698499a9 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.168685 Sep 06 04:43:18.401732 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 426/827] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:18 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:18.664380 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-79f2bf62-fcfa-4887-a49e-7dabc620f75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:18.665001 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-79f2bf62-fcfa-4887-a49e-7dabc620f75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:18.670997 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79f2bf62-fcfa-4887-a49e-7dabc620f75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:18.671475 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79f2bf62-fcfa-4887-a49e-7dabc620f75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:18.672167 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79f2bf62-fcfa-4887-a49e-7dabc620f75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:18.673418 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79f2bf62-fcfa-4887-a49e-7dabc620f75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:18.674543 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79f2bf62-fcfa-4887-a49e-7dabc620f75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:18.674972 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79f2bf62-fcfa-4887-a49e-7dabc620f75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:18.968205 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-79f2bf62-fcfa-4887-a49e-7dabc620f75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:18.976564 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-79f2bf62-fcfa-4887-a49e-7dabc620f75b tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1507 microversion: 2.1 time: 0.316064 Sep 06 04:43:18.977125 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 402/828] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:18 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1507 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:19.053815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-616a4861-2379-4bcb-85ea-f2bf7623c6da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:19.056761 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-616a4861-2379-4bcb-85ea-f2bf7623c6da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:19.060972 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-616a4861-2379-4bcb-85ea-f2bf7623c6da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:19.061490 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-616a4861-2379-4bcb-85ea-f2bf7623c6da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:19.061926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-616a4861-2379-4bcb-85ea-f2bf7623c6da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:19.062613 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-616a4861-2379-4bcb-85ea-f2bf7623c6da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:19.063067 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-616a4861-2379-4bcb-85ea-f2bf7623c6da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:19.063554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-616a4861-2379-4bcb-85ea-f2bf7623c6da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:19.084372 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:19.193104 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-41365f91-956a-412b-9322-6200ca9e33da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:19.193934 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-41365f91-956a-412b-9322-6200ca9e33da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:19.202125 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41365f91-956a-412b-9322-6200ca9e33da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:19.202233 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-616a4861-2379-4bcb-85ea-f2bf7623c6da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:19.202351 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41365f91-956a-412b-9322-6200ca9e33da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:19.202351 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41365f91-956a-412b-9322-6200ca9e33da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:19.202351 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41365f91-956a-412b-9322-6200ca9e33da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:19.202582 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41365f91-956a-412b-9322-6200ca9e33da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:19.203032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-41365f91-956a-412b-9322-6200ca9e33da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:19.209187 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-616a4861-2379-4bcb-85ea-f2bf7623c6da tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.159458 Sep 06 04:43:19.209824 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 427/829] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:19 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:19.333625 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-41365f91-956a-412b-9322-6200ca9e33da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:19.342129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-41365f91-956a-412b-9322-6200ca9e33da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:19.343545 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-41365f91-956a-412b-9322-6200ca9e33da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:19.344674 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-41365f91-956a-412b-9322-6200ca9e33da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.156659 Sep 06 04:43:19.345973 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 403/830] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:19 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:43:19.425615 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c54e36ef-22ab-440b-931b-66e566765dba tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:19.426217 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c54e36ef-22ab-440b-931b-66e566765dba tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:19.432200 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c54e36ef-22ab-440b-931b-66e566765dba tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:19.432679 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c54e36ef-22ab-440b-931b-66e566765dba tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:19.433104 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c54e36ef-22ab-440b-931b-66e566765dba tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:19.433805 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c54e36ef-22ab-440b-931b-66e566765dba tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:19.434258 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c54e36ef-22ab-440b-931b-66e566765dba tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:19.434675 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c54e36ef-22ab-440b-931b-66e566765dba tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:19.559586 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c54e36ef-22ab-440b-931b-66e566765dba tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:19.567911 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c54e36ef-22ab-440b-931b-66e566765dba tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.147272 Sep 06 04:43:19.568468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 428/831] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:19 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:20.002209 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c2da4b98-3ace-4788-a03e-8c4b2ef01966 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:20.003129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c2da4b98-3ace-4788-a03e-8c4b2ef01966 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:20.011825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2da4b98-3ace-4788-a03e-8c4b2ef01966 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:20.012537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2da4b98-3ace-4788-a03e-8c4b2ef01966 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:20.013196 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2da4b98-3ace-4788-a03e-8c4b2ef01966 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:20.014270 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2da4b98-3ace-4788-a03e-8c4b2ef01966 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:20.014970 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2da4b98-3ace-4788-a03e-8c4b2ef01966 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:20.015614 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c2da4b98-3ace-4788-a03e-8c4b2ef01966 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:20.150980 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c2da4b98-3ace-4788-a03e-8c4b2ef01966 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:20.159738 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c2da4b98-3ace-4788-a03e-8c4b2ef01966 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1507 microversion: 2.1 time: 0.163694 Sep 06 04:43:20.160300 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 404/832] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:19 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:20.232329 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-20c36a58-a531-4f7b-b7e0-7112a83a9934 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:20.232934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-20c36a58-a531-4f7b-b7e0-7112a83a9934 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:20.239577 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20c36a58-a531-4f7b-b7e0-7112a83a9934 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:20.240066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20c36a58-a531-4f7b-b7e0-7112a83a9934 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:20.240500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20c36a58-a531-4f7b-b7e0-7112a83a9934 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:20.241181 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20c36a58-a531-4f7b-b7e0-7112a83a9934 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:20.241664 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20c36a58-a531-4f7b-b7e0-7112a83a9934 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:20.242090 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-20c36a58-a531-4f7b-b7e0-7112a83a9934 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:20.370945 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e8cfbc25-8fff-4f55-9e7f-1dc4afeb0d4a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:20.371553 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e8cfbc25-8fff-4f55-9e7f-1dc4afeb0d4a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:20.373858 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:20.378684 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8cfbc25-8fff-4f55-9e7f-1dc4afeb0d4a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:20.381952 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8cfbc25-8fff-4f55-9e7f-1dc4afeb0d4a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:20.381952 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8cfbc25-8fff-4f55-9e7f-1dc4afeb0d4a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:20.381952 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8cfbc25-8fff-4f55-9e7f-1dc4afeb0d4a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:20.381952 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8cfbc25-8fff-4f55-9e7f-1dc4afeb0d4a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:20.382501 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e8cfbc25-8fff-4f55-9e7f-1dc4afeb0d4a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:20.385024 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-20c36a58-a531-4f7b-b7e0-7112a83a9934 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:20.393446 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-20c36a58-a531-4f7b-b7e0-7112a83a9934 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.164923 Sep 06 04:43:20.394017 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 429/833] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:20 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:20.509638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e8cfbc25-8fff-4f55-9e7f-1dc4afeb0d4a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:20.518463 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e8cfbc25-8fff-4f55-9e7f-1dc4afeb0d4a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:20.519887 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e8cfbc25-8fff-4f55-9e7f-1dc4afeb0d4a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:20.520982 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e8cfbc25-8fff-4f55-9e7f-1dc4afeb0d4a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.153909 Sep 06 04:43:20.521554 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 405/834] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:20 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:43:20.590566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-442e78ca-c8bf-4db4-8993-478be95cc998 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:20.591121 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-442e78ca-c8bf-4db4-8993-478be95cc998 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:20.597480 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-442e78ca-c8bf-4db4-8993-478be95cc998 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:20.597964 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-442e78ca-c8bf-4db4-8993-478be95cc998 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:20.598405 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-442e78ca-c8bf-4db4-8993-478be95cc998 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:20.599091 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-442e78ca-c8bf-4db4-8993-478be95cc998 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:20.599545 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-442e78ca-c8bf-4db4-8993-478be95cc998 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:20.599971 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-442e78ca-c8bf-4db4-8993-478be95cc998 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:20.728247 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-442e78ca-c8bf-4db4-8993-478be95cc998 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:20.735871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-442e78ca-c8bf-4db4-8993-478be95cc998 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.149247 Sep 06 04:43:20.736438 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 430/835] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:20 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:21.182990 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ef3a9a82-3e93-4eee-b727-3d4c3874855f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:21.183595 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ef3a9a82-3e93-4eee-b727-3d4c3874855f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:21.191216 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef3a9a82-3e93-4eee-b727-3d4c3874855f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:21.191824 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef3a9a82-3e93-4eee-b727-3d4c3874855f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:21.192322 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef3a9a82-3e93-4eee-b727-3d4c3874855f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:21.193026 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef3a9a82-3e93-4eee-b727-3d4c3874855f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:21.194905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef3a9a82-3e93-4eee-b727-3d4c3874855f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:21.194905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef3a9a82-3e93-4eee-b727-3d4c3874855f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:21.330612 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ef3a9a82-3e93-4eee-b727-3d4c3874855f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:21.338345 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ef3a9a82-3e93-4eee-b727-3d4c3874855f tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1507 microversion: 2.1 time: 0.159401 Sep 06 04:43:21.338897 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 406/836] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:21 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:21.417640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9bc82302-3cca-4f19-8d6f-245a15ee3e6c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:21.418242 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9bc82302-3cca-4f19-8d6f-245a15ee3e6c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:21.425207 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9bc82302-3cca-4f19-8d6f-245a15ee3e6c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:21.425713 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9bc82302-3cca-4f19-8d6f-245a15ee3e6c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:21.426145 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9bc82302-3cca-4f19-8d6f-245a15ee3e6c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:21.426815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9bc82302-3cca-4f19-8d6f-245a15ee3e6c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:21.427262 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9bc82302-3cca-4f19-8d6f-245a15ee3e6c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:21.427687 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9bc82302-3cca-4f19-8d6f-245a15ee3e6c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:21.545743 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-98af349c-3479-4c0b-818a-f2dd7ff01590 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:21.546443 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-98af349c-3479-4c0b-818a-f2dd7ff01590 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:21.554471 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98af349c-3479-4c0b-818a-f2dd7ff01590 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:21.554956 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98af349c-3479-4c0b-818a-f2dd7ff01590 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:21.555392 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98af349c-3479-4c0b-818a-f2dd7ff01590 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:21.556086 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98af349c-3479-4c0b-818a-f2dd7ff01590 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:21.556537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98af349c-3479-4c0b-818a-f2dd7ff01590 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:21.556960 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98af349c-3479-4c0b-818a-f2dd7ff01590 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:21.560141 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9bc82302-3cca-4f19-8d6f-245a15ee3e6c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:21.568358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9bc82302-3cca-4f19-8d6f-245a15ee3e6c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.154514 Sep 06 04:43:21.569213 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 431/837] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:21 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:21.686765 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-98af349c-3479-4c0b-818a-f2dd7ff01590 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:21.694748 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-98af349c-3479-4c0b-818a-f2dd7ff01590 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:21.696164 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-98af349c-3479-4c0b-818a-f2dd7ff01590 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:21.697251 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-98af349c-3479-4c0b-818a-f2dd7ff01590 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.155384 Sep 06 04:43:21.697820 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 407/838] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:21 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:43:21.758092 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-79127ff3-71fb-4997-abb4-345fa6df8f6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:21.758634 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-79127ff3-71fb-4997-abb4-345fa6df8f6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:21.764556 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79127ff3-71fb-4997-abb4-345fa6df8f6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:21.765035 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79127ff3-71fb-4997-abb4-345fa6df8f6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:21.765510 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79127ff3-71fb-4997-abb4-345fa6df8f6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:21.766189 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79127ff3-71fb-4997-abb4-345fa6df8f6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:21.767147 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79127ff3-71fb-4997-abb4-345fa6df8f6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:21.767567 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-79127ff3-71fb-4997-abb4-345fa6df8f6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:21.892602 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-79127ff3-71fb-4997-abb4-345fa6df8f6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:21.900349 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-79127ff3-71fb-4997-abb4-345fa6df8f6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.146089 Sep 06 04:43:21.900908 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 432/839] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:21 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:22.361673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cd63cfa4-c5ad-459f-a195-87980234696d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:22.362264 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cd63cfa4-c5ad-459f-a195-87980234696d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:22.368225 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd63cfa4-c5ad-459f-a195-87980234696d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:22.368705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd63cfa4-c5ad-459f-a195-87980234696d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:22.369141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd63cfa4-c5ad-459f-a195-87980234696d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:22.369860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd63cfa4-c5ad-459f-a195-87980234696d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:22.370316 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd63cfa4-c5ad-459f-a195-87980234696d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:22.374200 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cd63cfa4-c5ad-459f-a195-87980234696d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:22.498558 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cd63cfa4-c5ad-459f-a195-87980234696d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:22.506685 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cd63cfa4-c5ad-459f-a195-87980234696d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1507 microversion: 2.1 time: 0.149212 Sep 06 04:43:22.511499 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 408/840] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:22 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:22.592255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-68f3c5c9-0cd9-4f6f-afc6-52ec9d9d9d6a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:22.592864 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-68f3c5c9-0cd9-4f6f-afc6-52ec9d9d9d6a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:22.599465 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68f3c5c9-0cd9-4f6f-afc6-52ec9d9d9d6a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:22.600104 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68f3c5c9-0cd9-4f6f-afc6-52ec9d9d9d6a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:22.600541 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68f3c5c9-0cd9-4f6f-afc6-52ec9d9d9d6a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:22.601334 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68f3c5c9-0cd9-4f6f-afc6-52ec9d9d9d6a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:22.601822 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68f3c5c9-0cd9-4f6f-afc6-52ec9d9d9d6a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:22.602277 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68f3c5c9-0cd9-4f6f-afc6-52ec9d9d9d6a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:22.723625 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-958b5838-c7a3-48b1-ac32-6ecaa50b486c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:22.724352 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-958b5838-c7a3-48b1-ac32-6ecaa50b486c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:22.730624 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-958b5838-c7a3-48b1-ac32-6ecaa50b486c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:22.731115 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-958b5838-c7a3-48b1-ac32-6ecaa50b486c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:22.731545 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-958b5838-c7a3-48b1-ac32-6ecaa50b486c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:22.732236 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-958b5838-c7a3-48b1-ac32-6ecaa50b486c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:22.732683 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-958b5838-c7a3-48b1-ac32-6ecaa50b486c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:22.733098 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-958b5838-c7a3-48b1-ac32-6ecaa50b486c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:22.740788 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:22.818043 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-68f3c5c9-0cd9-4f6f-afc6-52ec9d9d9d6a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:22.825773 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-68f3c5c9-0cd9-4f6f-afc6-52ec9d9d9d6a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.237271 Sep 06 04:43:22.826337 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 433/841] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:22 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:22.864736 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-958b5838-c7a3-48b1-ac32-6ecaa50b486c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:22.872906 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-958b5838-c7a3-48b1-ac32-6ecaa50b486c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:22.874392 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-958b5838-c7a3-48b1-ac32-6ecaa50b486c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:22.875495 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-958b5838-c7a3-48b1-ac32-6ecaa50b486c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.157080 Sep 06 04:43:22.876156 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 409/842] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:22 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:43:22.924315 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a0c39404-0b48-4698-b4c7-8ad872cfa548 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:22.924912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a0c39404-0b48-4698-b4c7-8ad872cfa548 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:22.930818 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0c39404-0b48-4698-b4c7-8ad872cfa548 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:22.931297 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0c39404-0b48-4698-b4c7-8ad872cfa548 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:22.931726 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0c39404-0b48-4698-b4c7-8ad872cfa548 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:22.932402 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0c39404-0b48-4698-b4c7-8ad872cfa548 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:22.932852 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0c39404-0b48-4698-b4c7-8ad872cfa548 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:22.933271 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a0c39404-0b48-4698-b4c7-8ad872cfa548 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:23.063187 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a0c39404-0b48-4698-b4c7-8ad872cfa548 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:23.071127 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a0c39404-0b48-4698-b4c7-8ad872cfa548 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.151361 Sep 06 04:43:23.071692 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 434/843] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:22 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:23.534534 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6677603d-d97b-41c5-ab93-888fe033b65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:23.535142 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6677603d-d97b-41c5-ab93-888fe033b65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:23.541504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6677603d-d97b-41c5-ab93-888fe033b65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:23.541993 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6677603d-d97b-41c5-ab93-888fe033b65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:23.542427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6677603d-d97b-41c5-ab93-888fe033b65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:23.543116 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6677603d-d97b-41c5-ab93-888fe033b65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:23.543566 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6677603d-d97b-41c5-ab93-888fe033b65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:23.543985 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6677603d-d97b-41c5-ab93-888fe033b65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:23.669480 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6677603d-d97b-41c5-ab93-888fe033b65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:23.681040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6677603d-d97b-41c5-ab93-888fe033b65a tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1507 microversion: 2.1 time: 0.150693 Sep 06 04:43:23.687773 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 410/844] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:23 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:23.848872 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9549df40-1626-4b6d-9ae5-85b35d6582ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:23.849527 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9549df40-1626-4b6d-9ae5-85b35d6582ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:23.855997 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9549df40-1626-4b6d-9ae5-85b35d6582ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:23.856476 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9549df40-1626-4b6d-9ae5-85b35d6582ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:23.856910 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9549df40-1626-4b6d-9ae5-85b35d6582ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:23.857623 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9549df40-1626-4b6d-9ae5-85b35d6582ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:23.858078 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9549df40-1626-4b6d-9ae5-85b35d6582ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:23.858498 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9549df40-1626-4b6d-9ae5-85b35d6582ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:23.900185 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6f90c0de-f7f8-4110-995b-ae0a5d3e0de5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:23.900800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6f90c0de-f7f8-4110-995b-ae0a5d3e0de5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:23.907629 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f90c0de-f7f8-4110-995b-ae0a5d3e0de5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:23.913425 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f90c0de-f7f8-4110-995b-ae0a5d3e0de5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:23.913425 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f90c0de-f7f8-4110-995b-ae0a5d3e0de5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:23.913425 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f90c0de-f7f8-4110-995b-ae0a5d3e0de5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:23.913425 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f90c0de-f7f8-4110-995b-ae0a5d3e0de5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:23.913846 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6f90c0de-f7f8-4110-995b-ae0a5d3e0de5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:23.990687 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9549df40-1626-4b6d-9ae5-85b35d6582ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:23.998601 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9549df40-1626-4b6d-9ae5-85b35d6582ca tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.153550 Sep 06 04:43:23.999365 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 435/845] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:23 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:24.042179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6f90c0de-f7f8-4110-995b-ae0a5d3e0de5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:24.051004 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6f90c0de-f7f8-4110-995b-ae0a5d3e0de5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:24.052444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6f90c0de-f7f8-4110-995b-ae0a5d3e0de5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:24.053574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6f90c0de-f7f8-4110-995b-ae0a5d3e0de5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1407 microversion: 2.20 time: 0.157488 Sep 06 04:43:24.054130 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 411/846] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:23 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:43:24.094685 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4258c600-98b7-4150-9a01-48315bc19aa3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:24.095281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4258c600-98b7-4150-9a01-48315bc19aa3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:24.101083 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4258c600-98b7-4150-9a01-48315bc19aa3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:24.101592 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4258c600-98b7-4150-9a01-48315bc19aa3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:24.102025 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4258c600-98b7-4150-9a01-48315bc19aa3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:24.102693 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4258c600-98b7-4150-9a01-48315bc19aa3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:24.103140 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4258c600-98b7-4150-9a01-48315bc19aa3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:24.103553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4258c600-98b7-4150-9a01-48315bc19aa3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:24.330684 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4258c600-98b7-4150-9a01-48315bc19aa3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:24.341618 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4258c600-98b7-4150-9a01-48315bc19aa3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.250397 Sep 06 04:43:24.348224 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 436/847] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:24 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:24.706432 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-39c507ee-4fb9-45f1-90af-60aa0628bb1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:24.707013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-39c507ee-4fb9-45f1-90af-60aa0628bb1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:24.718321 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-39c507ee-4fb9-45f1-90af-60aa0628bb1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:24.718321 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-39c507ee-4fb9-45f1-90af-60aa0628bb1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:24.718321 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-39c507ee-4fb9-45f1-90af-60aa0628bb1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:24.718321 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-39c507ee-4fb9-45f1-90af-60aa0628bb1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:24.719113 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-39c507ee-4fb9-45f1-90af-60aa0628bb1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:24.719113 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-39c507ee-4fb9-45f1-90af-60aa0628bb1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:24.776476 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-38429daa-2835-4db5-9c71-8af2ae40010e req-40b32bd3-67a4-4575-b5f2-5728707953b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7855d2a-a4a4-44fa-9200-c2b74b273458", "name": "network-vif-deleted", "tag": "7dd08f26-fca9-44dc-9f2f-a94635106365"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:24.788819 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-38429daa-2835-4db5-9c71-8af2ae40010e req-40b32bd3-67a4-4575-b5f2-5728707953b9 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:24.789338 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-38429daa-2835-4db5-9c71-8af2ae40010e req-40b32bd3-67a4-4575-b5f2-5728707953b9 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:24.789758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-38429daa-2835-4db5-9c71-8af2ae40010e req-40b32bd3-67a4-4575-b5f2-5728707953b9 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:24.791691 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-39c507ee-4fb9-45f1-90af-60aa0628bb1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:24.801708 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-39c507ee-4fb9-45f1-90af-60aa0628bb1c tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1465 microversion: 2.1 time: 0.099679 Sep 06 04:43:24.802208 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-38429daa-2835-4db5-9c71-8af2ae40010e req-40b32bd3-67a4-4575-b5f2-5728707953b9 service nova] Creating event network-vif-deleted:7dd08f26-fca9-44dc-9f2f-a94635106365 for instance c7855d2a-a4a4-44fa-9200-c2b74b273458 on hv-cinder-85600 Sep 06 04:43:24.803192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 412/848] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:24 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1465 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:24.807860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-38429daa-2835-4db5-9c71-8af2ae40010e req-40b32bd3-67a4-4575-b5f2-5728707953b9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036164 Sep 06 04:43:24.815611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 437/849] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:43:25.024056 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a98da5a1-abeb-4d85-a9bf-f333f20dc95c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:25.024620 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a98da5a1-abeb-4d85-a9bf-f333f20dc95c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:25.031377 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a98da5a1-abeb-4d85-a9bf-f333f20dc95c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:25.031865 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a98da5a1-abeb-4d85-a9bf-f333f20dc95c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:25.032490 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a98da5a1-abeb-4d85-a9bf-f333f20dc95c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:25.033487 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a98da5a1-abeb-4d85-a9bf-f333f20dc95c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:25.033950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a98da5a1-abeb-4d85-a9bf-f333f20dc95c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:25.034377 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a98da5a1-abeb-4d85-a9bf-f333f20dc95c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:25.080615 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e85c7b93-9253-4f7f-97ce-c18346f8286e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:25.081400 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e85c7b93-9253-4f7f-97ce-c18346f8286e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:25.088455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e85c7b93-9253-4f7f-97ce-c18346f8286e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:25.089030 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e85c7b93-9253-4f7f-97ce-c18346f8286e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:25.089729 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e85c7b93-9253-4f7f-97ce-c18346f8286e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:25.090514 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e85c7b93-9253-4f7f-97ce-c18346f8286e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:25.091178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e85c7b93-9253-4f7f-97ce-c18346f8286e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:25.091656 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e85c7b93-9253-4f7f-97ce-c18346f8286e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:25.223976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a98da5a1-abeb-4d85-a9bf-f333f20dc95c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:25.238405 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a98da5a1-abeb-4d85-a9bf-f333f20dc95c tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.218241 Sep 06 04:43:25.239094 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 413/850] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:25 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:25.265820 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e85c7b93-9253-4f7f-97ce-c18346f8286e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:25.279077 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e85c7b93-9253-4f7f-97ce-c18346f8286e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:25.279077 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e85c7b93-9253-4f7f-97ce-c18346f8286e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:25.279077 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e85c7b93-9253-4f7f-97ce-c18346f8286e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1600 microversion: 2.20 time: 0.203929 Sep 06 04:43:25.279652 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 438/851] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:43:25 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1600 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:43:25.304452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fe809994-53ae-4996-82b5-5c025a5d20ef tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:25.304945 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fe809994-53ae-4996-82b5-5c025a5d20ef tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:25.310953 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fe809994-53ae-4996-82b5-5c025a5d20ef tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:25.311429 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fe809994-53ae-4996-82b5-5c025a5d20ef tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:25.311857 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fe809994-53ae-4996-82b5-5c025a5d20ef tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:25.312541 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fe809994-53ae-4996-82b5-5c025a5d20ef tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:25.312984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fe809994-53ae-4996-82b5-5c025a5d20ef tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:25.313652 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fe809994-53ae-4996-82b5-5c025a5d20ef tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:25.364438 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-22e2e85a-a278-4cfb-a285-f8cd82cde152 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:25.365764 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-22e2e85a-a278-4cfb-a285-f8cd82cde152 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:25.374329 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22e2e85a-a278-4cfb-a285-f8cd82cde152 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:25.375130 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22e2e85a-a278-4cfb-a285-f8cd82cde152 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:25.375723 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22e2e85a-a278-4cfb-a285-f8cd82cde152 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:25.377372 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22e2e85a-a278-4cfb-a285-f8cd82cde152 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:25.378061 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22e2e85a-a278-4cfb-a285-f8cd82cde152 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:25.378738 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22e2e85a-a278-4cfb-a285-f8cd82cde152 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:25.399599 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fe809994-53ae-4996-82b5-5c025a5d20ef tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.098899 Sep 06 04:43:25.400194 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 414/852] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Sep 6 04:43:25 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:43:25.515264 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-22e2e85a-a278-4cfb-a285-f8cd82cde152 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:25.523222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-22e2e85a-a278-4cfb-a285-f8cd82cde152 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.163180 Sep 06 04:43:25.523790 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 439/853] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:25 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:43:25.826941 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3fa8af54-ccaa-46de-8018-f395fff43d22 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:25.827676 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3fa8af54-ccaa-46de-8018-f395fff43d22 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:25.834043 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fa8af54-ccaa-46de-8018-f395fff43d22 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:25.834535 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fa8af54-ccaa-46de-8018-f395fff43d22 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:25.834977 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fa8af54-ccaa-46de-8018-f395fff43d22 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:25.835673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fa8af54-ccaa-46de-8018-f395fff43d22 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:25.836132 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fa8af54-ccaa-46de-8018-f395fff43d22 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:25.836556 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fa8af54-ccaa-46de-8018-f395fff43d22 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:25.869076 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fa8af54-ccaa-46de-8018-f395fff43d22 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:25.869594 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fa8af54-ccaa-46de-8018-f395fff43d22 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:25.870027 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fa8af54-ccaa-46de-8018-f395fff43d22 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:25.870476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-3fa8af54-ccaa-46de-8018-f395fff43d22 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lazy-loading 'fault' on Instance uuid c7855d2a-a4a4-44fa-9200-c2b74b273458 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:43:25.913093 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3fa8af54-ccaa-46de-8018-f395fff43d22 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:25.920707 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3fa8af54-ccaa-46de-8018-f395fff43d22 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1312 microversion: 2.1 time: 0.097715 Sep 06 04:43:25.921261 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 415/854] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:25 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:26.264575 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3cc0a757-4f6b-4f9d-a427-3356cac2a3e9 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:26.265496 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3cc0a757-4f6b-4f9d-a427-3356cac2a3e9 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:26.271721 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3cc0a757-4f6b-4f9d-a427-3356cac2a3e9 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:26.272218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3cc0a757-4f6b-4f9d-a427-3356cac2a3e9 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:26.272646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3cc0a757-4f6b-4f9d-a427-3356cac2a3e9 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:26.273564 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3cc0a757-4f6b-4f9d-a427-3356cac2a3e9 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:26.274021 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3cc0a757-4f6b-4f9d-a427-3356cac2a3e9 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:26.279176 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3cc0a757-4f6b-4f9d-a427-3356cac2a3e9 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:26.388215 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-7f0264f7-aaa8-4a58-95a7-c67c7db366ee req-36c1dda4-a264-4865-bd55-f33a9beb5a76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "821737e4-9236-4f80-b1ac-8c4d16c02244", "tag": "3e4ec09b-2a4b-41e0-871c-50fd282365c6"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:26.396457 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7f0264f7-aaa8-4a58-95a7-c67c7db366ee req-36c1dda4-a264-4865-bd55-f33a9beb5a76 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:26.397144 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7f0264f7-aaa8-4a58-95a7-c67c7db366ee req-36c1dda4-a264-4865-bd55-f33a9beb5a76 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:26.397781 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7f0264f7-aaa8-4a58-95a7-c67c7db366ee req-36c1dda4-a264-4865-bd55-f33a9beb5a76 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:26.409732 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-7f0264f7-aaa8-4a58-95a7-c67c7db366ee req-36c1dda4-a264-4865-bd55-f33a9beb5a76 service nova] Creating event network-changed:3e4ec09b-2a4b-41e0-871c-50fd282365c6 for instance 821737e4-9236-4f80-b1ac-8c4d16c02244 on hv-cinder-85600 Sep 06 04:43:26.415002 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-7f0264f7-aaa8-4a58-95a7-c67c7db366ee req-36c1dda4-a264-4865-bd55-f33a9beb5a76 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032429 Sep 06 04:43:26.416261 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 416/855] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:43:26.429639 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3cc0a757-4f6b-4f9d-a427-3356cac2a3e9 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:26.437490 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3cc0a757-4f6b-4f9d-a427-3356cac2a3e9 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.177378 Sep 06 04:43:26.438148 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 440/856] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:26 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:26.546341 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bad0c251-83b7-4f30-a4db-72ebca6d1fc1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:26.547084 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bad0c251-83b7-4f30-a4db-72ebca6d1fc1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:26.554483 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bad0c251-83b7-4f30-a4db-72ebca6d1fc1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:26.555011 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bad0c251-83b7-4f30-a4db-72ebca6d1fc1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:26.555444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bad0c251-83b7-4f30-a4db-72ebca6d1fc1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:26.556144 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bad0c251-83b7-4f30-a4db-72ebca6d1fc1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:26.556595 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bad0c251-83b7-4f30-a4db-72ebca6d1fc1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:26.557016 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bad0c251-83b7-4f30-a4db-72ebca6d1fc1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:26.686110 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bad0c251-83b7-4f30-a4db-72ebca6d1fc1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:26.694312 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bad0c251-83b7-4f30-a4db-72ebca6d1fc1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.152222 Sep 06 04:43:26.694867 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 417/857] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:26 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:26.944617 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3243ec9c-4012-4fc3-9b72-2d4b117b6539 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:26.945224 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3243ec9c-4012-4fc3-9b72-2d4b117b6539 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:26.947221 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:26.951864 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3243ec9c-4012-4fc3-9b72-2d4b117b6539 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:26.952343 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3243ec9c-4012-4fc3-9b72-2d4b117b6539 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:26.952773 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3243ec9c-4012-4fc3-9b72-2d4b117b6539 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:26.953484 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3243ec9c-4012-4fc3-9b72-2d4b117b6539 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:26.953965 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3243ec9c-4012-4fc3-9b72-2d4b117b6539 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:26.954381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3243ec9c-4012-4fc3-9b72-2d4b117b6539 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:26.986121 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3243ec9c-4012-4fc3-9b72-2d4b117b6539 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:26.986606 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3243ec9c-4012-4fc3-9b72-2d4b117b6539 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:26.987028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3243ec9c-4012-4fc3-9b72-2d4b117b6539 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:26.987470 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-3243ec9c-4012-4fc3-9b72-2d4b117b6539 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lazy-loading 'fault' on Instance uuid c7855d2a-a4a4-44fa-9200-c2b74b273458 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:43:27.031111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3243ec9c-4012-4fc3-9b72-2d4b117b6539 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:27.039008 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3243ec9c-4012-4fc3-9b72-2d4b117b6539 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1312 microversion: 2.1 time: 0.098353 Sep 06 04:43:27.039647 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 441/858] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:26 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1312 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:27.461549 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-82b514ca-b09b-4153-86f0-4716605aa3d5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:27.462107 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-82b514ca-b09b-4153-86f0-4716605aa3d5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:27.468444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-82b514ca-b09b-4153-86f0-4716605aa3d5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:27.468918 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-82b514ca-b09b-4153-86f0-4716605aa3d5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:27.469369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-82b514ca-b09b-4153-86f0-4716605aa3d5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:27.470884 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-82b514ca-b09b-4153-86f0-4716605aa3d5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:27.471341 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-82b514ca-b09b-4153-86f0-4716605aa3d5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:27.471763 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-82b514ca-b09b-4153-86f0-4716605aa3d5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:27.606083 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-82b514ca-b09b-4153-86f0-4716605aa3d5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:27.614203 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-82b514ca-b09b-4153-86f0-4716605aa3d5 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.156575 Sep 06 04:43:27.614760 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 418/859] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:27 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:27.717095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e8a4bf3a-ffb4-48be-922f-54ab559a0105 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:27.717650 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e8a4bf3a-ffb4-48be-922f-54ab559a0105 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:27.724907 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8a4bf3a-ffb4-48be-922f-54ab559a0105 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:27.725450 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8a4bf3a-ffb4-48be-922f-54ab559a0105 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:27.725890 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8a4bf3a-ffb4-48be-922f-54ab559a0105 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:27.726664 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8a4bf3a-ffb4-48be-922f-54ab559a0105 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:27.727124 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8a4bf3a-ffb4-48be-922f-54ab559a0105 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:27.727548 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e8a4bf3a-ffb4-48be-922f-54ab559a0105 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:27.853507 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e8a4bf3a-ffb4-48be-922f-54ab559a0105 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:27.861106 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e8a4bf3a-ffb4-48be-922f-54ab559a0105 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.147907 Sep 06 04:43:27.872359 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 442/860] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:27 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:28.062905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e6a1f6f0-9f11-4075-8cd2-55ef353cfc8d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:28.064083 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e6a1f6f0-9f11-4075-8cd2-55ef353cfc8d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:28.070528 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6a1f6f0-9f11-4075-8cd2-55ef353cfc8d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:28.071075 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6a1f6f0-9f11-4075-8cd2-55ef353cfc8d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:28.080211 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6a1f6f0-9f11-4075-8cd2-55ef353cfc8d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:28.083576 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6a1f6f0-9f11-4075-8cd2-55ef353cfc8d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:28.083576 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6a1f6f0-9f11-4075-8cd2-55ef353cfc8d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:28.083576 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6a1f6f0-9f11-4075-8cd2-55ef353cfc8d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:28.116972 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6a1f6f0-9f11-4075-8cd2-55ef353cfc8d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:28.117490 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6a1f6f0-9f11-4075-8cd2-55ef353cfc8d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:28.117928 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e6a1f6f0-9f11-4075-8cd2-55ef353cfc8d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:28.118573 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-e6a1f6f0-9f11-4075-8cd2-55ef353cfc8d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lazy-loading 'fault' on Instance uuid c7855d2a-a4a4-44fa-9200-c2b74b273458 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:43:28.174701 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e6a1f6f0-9f11-4075-8cd2-55ef353cfc8d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:28.182480 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e6a1f6f0-9f11-4075-8cd2-55ef353cfc8d tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 200 len: 1312 microversion: 2.1 time: 0.123381 Sep 06 04:43:28.197329 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 419/861] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:28 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 1312 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:28.637154 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-68f687ce-4dd4-4f0f-bb02-afffe608916e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:28.637891 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-68f687ce-4dd4-4f0f-bb02-afffe608916e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:28.651217 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68f687ce-4dd4-4f0f-bb02-afffe608916e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:28.651868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68f687ce-4dd4-4f0f-bb02-afffe608916e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:28.652360 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68f687ce-4dd4-4f0f-bb02-afffe608916e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:28.653423 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68f687ce-4dd4-4f0f-bb02-afffe608916e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:28.653990 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68f687ce-4dd4-4f0f-bb02-afffe608916e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:28.654593 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-68f687ce-4dd4-4f0f-bb02-afffe608916e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:28.812358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-68f687ce-4dd4-4f0f-bb02-afffe608916e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:28.822346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-68f687ce-4dd4-4f0f-bb02-afffe608916e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.189051 Sep 06 04:43:28.823031 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 443/862] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:28 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:28.884085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3c77687c-269e-4fef-8995-897bb285ccaf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:28.884700 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3c77687c-269e-4fef-8995-897bb285ccaf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:28.891941 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c77687c-269e-4fef-8995-897bb285ccaf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:28.892672 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c77687c-269e-4fef-8995-897bb285ccaf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:28.893118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c77687c-269e-4fef-8995-897bb285ccaf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:28.893862 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c77687c-269e-4fef-8995-897bb285ccaf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:28.894323 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c77687c-269e-4fef-8995-897bb285ccaf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:28.894746 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c77687c-269e-4fef-8995-897bb285ccaf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:29.029653 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3c77687c-269e-4fef-8995-897bb285ccaf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:29.039640 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3c77687c-269e-4fef-8995-897bb285ccaf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.159239 Sep 06 04:43:29.040269 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 420/863] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:28 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:29.208009 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3cbd1c1e-e0f0-4cb5-8bc0-2d521b9f2ead tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:29.208622 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3cbd1c1e-e0f0-4cb5-8bc0-2d521b9f2ead tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: c7855d2a-a4a4-44fa-9200-c2b74b273458] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:29.214686 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3cbd1c1e-e0f0-4cb5-8bc0-2d521b9f2ead tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:29.215204 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3cbd1c1e-e0f0-4cb5-8bc0-2d521b9f2ead tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:29.215643 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3cbd1c1e-e0f0-4cb5-8bc0-2d521b9f2ead tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:29.216334 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3cbd1c1e-e0f0-4cb5-8bc0-2d521b9f2ead tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:29.216797 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3cbd1c1e-e0f0-4cb5-8bc0-2d521b9f2ead tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:29.217233 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3cbd1c1e-e0f0-4cb5-8bc0-2d521b9f2ead tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:29.231476 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-3cbd1c1e-e0f0-4cb5-8bc0-2d521b9f2ead tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] HTTP exception thrown: Instance c7855d2a-a4a4-44fa-9200-c2b74b273458 could not be found. Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3cbd1c1e-e0f0-4cb5-8bc0-2d521b9f2ead tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Request method failure captured: Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 HTTP/1.1 Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs4ShSrtmqUjFGUKG962wNt7LkzYM3H0fxdZ4mdnzTKicnH2a1pwDbv7dv5CWGNDm2D2-tqaRREzJYjQqF33RYhMiNEgLbULGTL6P0__4bHirkaw0M3xA0fCopVUzt_zEi1at48QcuQnfkdAMrCCuCfH2J4_6gox-co2Z-Cq2ue1hT0 Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 7aa4ca550edd4876a4c6c56deedf9d70 Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1362344250 Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:43:29.233095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:43:29.234846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:43:29.234846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1362344250 Sep 06 04:43:29.234846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 7aa4ca550edd4876a4c6c56deedf9d70 Sep 06 04:43:29.234846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1362344250 Sep 06 04:43:29.234846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-ServerRescueNegativeTestJSON-1362344250-project Sep 06 04:43:29.234846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:43:29.234846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:43:29.234846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: dec1c17550b849dbadbc16e98530b455 Sep 06 04:43:29.234846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1362344250-project Sep 06 04:43:29.234846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:43:29.234846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance c7855d2a-a4a4-44fa-9200-c2b74b273458 could not be found. Sep 06 04:43:29.234846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': 'c7855d2a-a4a4-44fa-9200-c2b74b273458'} Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7855d2a-a4a4-44fa-9200-c2b74b273458 could not be found. Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:43:29.235788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7855d2a-a4a4-44fa-9200-c2b74b273458 could not be found. Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7855d2a-a4a4-44fa-9200-c2b74b273458 could not be found. Sep 06 04:43:29.237269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:43:29.238460 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3cbd1c1e-e0f0-4cb5-8bc0-2d521b9f2ead tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Returning 404 to user: Instance c7855d2a-a4a4-44fa-9200-c2b74b273458 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:43:29.238460 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3cbd1c1e-e0f0-4cb5-8bc0-2d521b9f2ead tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458" status: 404 len: 111 microversion: 2.1 time: 0.031112 Sep 06 04:43:29.238460 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 444/864] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:29 2022] GET /compute/v2.1/servers/c7855d2a-a4a4-44fa-9200-c2b74b273458 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:43:29.243733 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8fb3c396-78ff-490d-927d-3c50a33d2015 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:29.244223 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8fb3c396-78ff-490d-927d-3c50a33d2015 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:29.250388 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fb3c396-78ff-490d-927d-3c50a33d2015 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:29.251035 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fb3c396-78ff-490d-927d-3c50a33d2015 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:29.251624 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fb3c396-78ff-490d-927d-3c50a33d2015 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:29.252160 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fb3c396-78ff-490d-927d-3c50a33d2015 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:29.252611 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fb3c396-78ff-490d-927d-3c50a33d2015 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:29.253026 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8fb3c396-78ff-490d-927d-3c50a33d2015 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:29.278694 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8fb3c396-78ff-490d-927d-3c50a33d2015 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:43:29.635719 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8fb3c396-78ff-490d-927d-3c50a33d2015 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 204 len: 0 microversion: 2.1 time: 0.395653 Sep 06 04:43:29.636301 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 421/865] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:43:29 2022] DELETE /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:43:29.645189 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cd596437-cb91-46ef-8641-9e16f9a636b9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:29.649609 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cd596437-cb91-46ef-8641-9e16f9a636b9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:29.651749 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd596437-cb91-46ef-8641-9e16f9a636b9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:29.652235 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd596437-cb91-46ef-8641-9e16f9a636b9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:29.652670 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd596437-cb91-46ef-8641-9e16f9a636b9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:29.653650 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd596437-cb91-46ef-8641-9e16f9a636b9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:29.654105 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd596437-cb91-46ef-8641-9e16f9a636b9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:29.654532 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cd596437-cb91-46ef-8641-9e16f9a636b9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:29.658657 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:29.786097 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cd596437-cb91-46ef-8641-9e16f9a636b9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:29.793840 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cd596437-cb91-46ef-8641-9e16f9a636b9 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.153273 Sep 06 04:43:29.794406 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 445/866] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:29 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:29.846920 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6dfd8cf1-ad1c-4fa8-9875-faa8136bb414 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:29.850116 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6dfd8cf1-ad1c-4fa8-9875-faa8136bb414 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:29.853835 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6dfd8cf1-ad1c-4fa8-9875-faa8136bb414 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:29.854310 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6dfd8cf1-ad1c-4fa8-9875-faa8136bb414 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:29.854737 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6dfd8cf1-ad1c-4fa8-9875-faa8136bb414 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:29.855414 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6dfd8cf1-ad1c-4fa8-9875-faa8136bb414 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:29.855881 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6dfd8cf1-ad1c-4fa8-9875-faa8136bb414 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:29.856295 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6dfd8cf1-ad1c-4fa8-9875-faa8136bb414 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:29.997703 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6dfd8cf1-ad1c-4fa8-9875-faa8136bb414 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:30.006368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6dfd8cf1-ad1c-4fa8-9875-faa8136bb414 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.164080 Sep 06 04:43:30.006942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 422/867] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:29 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:30.012483 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-6ee11709-825c-41e0-994c-d49e952b795b req-115b03d2-9da0-4b44-847e-6fa1c4e4bb5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6c1b505-babf-4fde-b18b-7d72d9cc0acc", "name": "network-vif-plugged", "status": "completed", "tag": "2a57860e-e2d2-4ede-943c-6db28a3cdf5a"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:30.025833 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-6ee11709-825c-41e0-994c-d49e952b795b req-115b03d2-9da0-4b44-847e-6fa1c4e4bb5d service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:30.026341 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-6ee11709-825c-41e0-994c-d49e952b795b req-115b03d2-9da0-4b44-847e-6fa1c4e4bb5d service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:30.026776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-6ee11709-825c-41e0-994c-d49e952b795b req-115b03d2-9da0-4b44-847e-6fa1c4e4bb5d service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:30.038766 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-6ee11709-825c-41e0-994c-d49e952b795b req-115b03d2-9da0-4b44-847e-6fa1c4e4bb5d service nova] Creating event network-vif-plugged:2a57860e-e2d2-4ede-943c-6db28a3cdf5a for instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc on hv-cinder-85600 Sep 06 04:43:30.043566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-6ee11709-825c-41e0-994c-d49e952b795b req-115b03d2-9da0-4b44-847e-6fa1c4e4bb5d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034854 Sep 06 04:43:30.044099 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 446/868] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:43:30.062747 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-97ebccbb-3db7-4acf-a81d-6e7a312da0ec tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:30.063504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-97ebccbb-3db7-4acf-a81d-6e7a312da0ec tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:30.069464 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97ebccbb-3db7-4acf-a81d-6e7a312da0ec tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:30.070123 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97ebccbb-3db7-4acf-a81d-6e7a312da0ec tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:30.070567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97ebccbb-3db7-4acf-a81d-6e7a312da0ec tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:30.071250 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97ebccbb-3db7-4acf-a81d-6e7a312da0ec tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:30.071751 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97ebccbb-3db7-4acf-a81d-6e7a312da0ec tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:30.072173 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-97ebccbb-3db7-4acf-a81d-6e7a312da0ec tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:30.215716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-97ebccbb-3db7-4acf-a81d-6e7a312da0ec tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:30.223604 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-97ebccbb-3db7-4acf-a81d-6e7a312da0ec tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.164721 Sep 06 04:43:30.224178 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 423/869] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:30 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:30.818555 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4741dc74-89c2-4703-a93c-1a68b091eac1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:30.819239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4741dc74-89c2-4703-a93c-1a68b091eac1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:30.825292 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4741dc74-89c2-4703-a93c-1a68b091eac1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:30.825800 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4741dc74-89c2-4703-a93c-1a68b091eac1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:30.826230 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4741dc74-89c2-4703-a93c-1a68b091eac1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:30.826909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4741dc74-89c2-4703-a93c-1a68b091eac1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:30.827361 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4741dc74-89c2-4703-a93c-1a68b091eac1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:30.827778 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4741dc74-89c2-4703-a93c-1a68b091eac1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:30.953675 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4741dc74-89c2-4703-a93c-1a68b091eac1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:30.961260 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4741dc74-89c2-4703-a93c-1a68b091eac1 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1520 microversion: 2.1 time: 0.148091 Sep 06 04:43:30.961848 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 447/870] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:30 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:31.030514 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cb52aafc-01b4-4dc2-a6c9-801ba91b6546 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:31.031230 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cb52aafc-01b4-4dc2-a6c9-801ba91b6546 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:31.038635 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb52aafc-01b4-4dc2-a6c9-801ba91b6546 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:31.039116 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb52aafc-01b4-4dc2-a6c9-801ba91b6546 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:31.039699 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb52aafc-01b4-4dc2-a6c9-801ba91b6546 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:31.040388 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb52aafc-01b4-4dc2-a6c9-801ba91b6546 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:31.040832 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb52aafc-01b4-4dc2-a6c9-801ba91b6546 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:31.041273 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb52aafc-01b4-4dc2-a6c9-801ba91b6546 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:31.061015 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:31.246424 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a8c6cbf9-0beb-42e8-bea7-b27696d4b043 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:31.247181 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a8c6cbf9-0beb-42e8-bea7-b27696d4b043 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:31.253289 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8c6cbf9-0beb-42e8-bea7-b27696d4b043 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:31.253879 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8c6cbf9-0beb-42e8-bea7-b27696d4b043 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:31.254314 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8c6cbf9-0beb-42e8-bea7-b27696d4b043 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:31.255002 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8c6cbf9-0beb-42e8-bea7-b27696d4b043 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:31.255448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8c6cbf9-0beb-42e8-bea7-b27696d4b043 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:31.255865 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8c6cbf9-0beb-42e8-bea7-b27696d4b043 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:31.265601 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cb52aafc-01b4-4dc2-a6c9-801ba91b6546 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:31.273707 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cb52aafc-01b4-4dc2-a6c9-801ba91b6546 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.247473 Sep 06 04:43:31.274665 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 424/871] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:31 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:31.404887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a8c6cbf9-0beb-42e8-bea7-b27696d4b043 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:31.413421 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a8c6cbf9-0beb-42e8-bea7-b27696d4b043 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.170886 Sep 06 04:43:31.414183 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 448/872] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:31 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:43:31.573004 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-de3c8f86-3797-4895-a2a6-361180d669f5 req-0378fb82-326a-4189-bc59-0989d06e0dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed927594-12ef-48af-b170-5b88f8ecb0ec", "name": "network-vif-deleted", "tag": "831811de-3ef7-415e-be56-fafeee2815c2"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:31.583074 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-de3c8f86-3797-4895-a2a6-361180d669f5 req-0378fb82-326a-4189-bc59-0989d06e0dc8 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:31.583675 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-de3c8f86-3797-4895-a2a6-361180d669f5 req-0378fb82-326a-4189-bc59-0989d06e0dc8 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:31.584107 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-de3c8f86-3797-4895-a2a6-361180d669f5 req-0378fb82-326a-4189-bc59-0989d06e0dc8 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:31.594945 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-de3c8f86-3797-4895-a2a6-361180d669f5 req-0378fb82-326a-4189-bc59-0989d06e0dc8 service nova] Creating event network-vif-deleted:831811de-3ef7-415e-be56-fafeee2815c2 for instance ed927594-12ef-48af-b170-5b88f8ecb0ec on hv-cinder-85600 Sep 06 04:43:31.600400 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-de3c8f86-3797-4895-a2a6-361180d669f5 req-0378fb82-326a-4189-bc59-0989d06e0dc8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031488 Sep 06 04:43:31.600973 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 425/873] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:43:31.984817 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-06fac3a0-7de4-4c01-acf9-2d49bf6e9e02 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:31.985522 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-06fac3a0-7de4-4c01-acf9-2d49bf6e9e02 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:31.994705 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-06fac3a0-7de4-4c01-acf9-2d49bf6e9e02 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:31.994705 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-06fac3a0-7de4-4c01-acf9-2d49bf6e9e02 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:31.994705 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-06fac3a0-7de4-4c01-acf9-2d49bf6e9e02 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:31.995017 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-06fac3a0-7de4-4c01-acf9-2d49bf6e9e02 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:31.995226 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-06fac3a0-7de4-4c01-acf9-2d49bf6e9e02 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:31.995666 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-06fac3a0-7de4-4c01-acf9-2d49bf6e9e02 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:32.035519 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-06fac3a0-7de4-4c01-acf9-2d49bf6e9e02 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:32.036000 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-06fac3a0-7de4-4c01-acf9-2d49bf6e9e02 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:32.036438 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-06fac3a0-7de4-4c01-acf9-2d49bf6e9e02 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:32.036881 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-06fac3a0-7de4-4c01-acf9-2d49bf6e9e02 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lazy-loading 'fault' on Instance uuid ed927594-12ef-48af-b170-5b88f8ecb0ec {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:43:32.077539 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-06fac3a0-7de4-4c01-acf9-2d49bf6e9e02 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:32.085755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-06fac3a0-7de4-4c01-acf9-2d49bf6e9e02 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1311 microversion: 2.1 time: 0.104827 Sep 06 04:43:32.086312 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 449/874] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:31 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:32.297942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d2f382f3-298e-49b7-8c4c-e3a23223225a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:32.298588 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d2f382f3-298e-49b7-8c4c-e3a23223225a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:32.305002 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f382f3-298e-49b7-8c4c-e3a23223225a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:32.305527 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f382f3-298e-49b7-8c4c-e3a23223225a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:32.305964 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f382f3-298e-49b7-8c4c-e3a23223225a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:32.306657 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f382f3-298e-49b7-8c4c-e3a23223225a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:32.307129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f382f3-298e-49b7-8c4c-e3a23223225a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:32.307560 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f382f3-298e-49b7-8c4c-e3a23223225a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:32.436079 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-91836980-d7de-4b96-b27a-f2c8270c0fc4 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:32.436684 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-91836980-d7de-4b96-b27a-f2c8270c0fc4 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:32.443248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91836980-d7de-4b96-b27a-f2c8270c0fc4 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:32.443734 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91836980-d7de-4b96-b27a-f2c8270c0fc4 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:32.444172 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91836980-d7de-4b96-b27a-f2c8270c0fc4 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:32.445092 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91836980-d7de-4b96-b27a-f2c8270c0fc4 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:32.445586 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91836980-d7de-4b96-b27a-f2c8270c0fc4 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:32.446012 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91836980-d7de-4b96-b27a-f2c8270c0fc4 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:32.459979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d2f382f3-298e-49b7-8c4c-e3a23223225a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:32.467673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d2f382f3-298e-49b7-8c4c-e3a23223225a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.174766 Sep 06 04:43:32.468245 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 426/875] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:32 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:32.574732 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-91836980-d7de-4b96-b27a-f2c8270c0fc4 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:32.582525 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-91836980-d7de-4b96-b27a-f2c8270c0fc4 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1357 microversion: 2.1 time: 0.150327 Sep 06 04:43:32.583127 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 450/876] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:32 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:43:33.108941 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0536e80e-d1e0-458e-a086-bf583f811005 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:33.109570 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0536e80e-d1e0-458e-a086-bf583f811005 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:33.115713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0536e80e-d1e0-458e-a086-bf583f811005 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:33.116192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0536e80e-d1e0-458e-a086-bf583f811005 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:33.116624 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0536e80e-d1e0-458e-a086-bf583f811005 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:33.117325 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0536e80e-d1e0-458e-a086-bf583f811005 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:33.117788 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0536e80e-d1e0-458e-a086-bf583f811005 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:33.118203 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0536e80e-d1e0-458e-a086-bf583f811005 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:33.151109 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0536e80e-d1e0-458e-a086-bf583f811005 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:33.151581 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0536e80e-d1e0-458e-a086-bf583f811005 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:33.152007 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0536e80e-d1e0-458e-a086-bf583f811005 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:33.152437 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-0536e80e-d1e0-458e-a086-bf583f811005 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lazy-loading 'fault' on Instance uuid ed927594-12ef-48af-b170-5b88f8ecb0ec {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:43:33.196316 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0536e80e-d1e0-458e-a086-bf583f811005 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dec1c17550b849dbadbc16e98530b455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa4ca550edd4876a4c6c56deedf9d70', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:33.204103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0536e80e-d1e0-458e-a086-bf583f811005 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 200 len: 1311 microversion: 2.1 time: 0.099087 Sep 06 04:43:33.204658 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 427/877] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:33 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:33.491770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a440e6ff-a07d-4407-ad81-64aac3f79268 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:33.492373 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a440e6ff-a07d-4407-ad81-64aac3f79268 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:33.498746 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a440e6ff-a07d-4407-ad81-64aac3f79268 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:33.499270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a440e6ff-a07d-4407-ad81-64aac3f79268 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:33.499701 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a440e6ff-a07d-4407-ad81-64aac3f79268 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:33.500375 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a440e6ff-a07d-4407-ad81-64aac3f79268 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:33.500827 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a440e6ff-a07d-4407-ad81-64aac3f79268 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:33.501246 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a440e6ff-a07d-4407-ad81-64aac3f79268 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:33.605566 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6d242d46-0675-4283-84c2-b46d0138a33c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:33.606173 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6d242d46-0675-4283-84c2-b46d0138a33c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:33.612431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d242d46-0675-4283-84c2-b46d0138a33c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:33.613523 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d242d46-0675-4283-84c2-b46d0138a33c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:33.614119 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d242d46-0675-4283-84c2-b46d0138a33c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:33.614814 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d242d46-0675-4283-84c2-b46d0138a33c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:33.615260 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d242d46-0675-4283-84c2-b46d0138a33c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:33.615676 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6d242d46-0675-4283-84c2-b46d0138a33c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:33.634766 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a440e6ff-a07d-4407-ad81-64aac3f79268 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:33.642525 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a440e6ff-a07d-4407-ad81-64aac3f79268 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.154711 Sep 06 04:43:33.643090 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 451/878] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:33 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:34.092693 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6d242d46-0675-4283-84c2-b46d0138a33c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:34.102299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6d242d46-0675-4283-84c2-b46d0138a33c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1547 microversion: 2.1 time: 0.500504 Sep 06 04:43:34.102882 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 428/879] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:33 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1547 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:43:34.128475 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d2a64fee-828a-4bd8-95db-83dce6ab2f6b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:34.129096 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d2a64fee-828a-4bd8-95db-83dce6ab2f6b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:34.135102 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2a64fee-828a-4bd8-95db-83dce6ab2f6b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:34.135581 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2a64fee-828a-4bd8-95db-83dce6ab2f6b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:34.136014 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2a64fee-828a-4bd8-95db-83dce6ab2f6b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:34.136703 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2a64fee-828a-4bd8-95db-83dce6ab2f6b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:34.137156 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2a64fee-828a-4bd8-95db-83dce6ab2f6b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:34.137609 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d2a64fee-828a-4bd8-95db-83dce6ab2f6b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:34.228647 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-31749bad-1a30-4201-9e22-89f6bcb96817 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:34.229546 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-31749bad-1a30-4201-9e22-89f6bcb96817 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] [instance: ed927594-12ef-48af-b170-5b88f8ecb0ec] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:34.235626 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31749bad-1a30-4201-9e22-89f6bcb96817 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:34.238300 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31749bad-1a30-4201-9e22-89f6bcb96817 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:34.238300 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31749bad-1a30-4201-9e22-89f6bcb96817 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:34.238300 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31749bad-1a30-4201-9e22-89f6bcb96817 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:34.238300 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31749bad-1a30-4201-9e22-89f6bcb96817 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:34.238782 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31749bad-1a30-4201-9e22-89f6bcb96817 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:34.252889 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-31749bad-1a30-4201-9e22-89f6bcb96817 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] HTTP exception thrown: Instance ed927594-12ef-48af-b170-5b88f8ecb0ec could not be found. Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-31749bad-1a30-4201-9e22-89f6bcb96817 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Request method failure captured: Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec HTTP/1.1 Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4ShSrtmqUjFGUKG962wNt7LkzYM3H0fxdZ4mdnzTKicnH2a1pwDbv7dv5CWGNDm2D2-tqaRREzJYjQqF33RYhMiNEgLbULGTL6P0__4bHirkaw0M3xA0fCopVUzt_zEi1at48QcuQnfkdAMrCCuCfH2J4_6gox-co2Z-Cq2ue1hT0 Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 7aa4ca550edd4876a4c6c56deedf9d70 Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1362344250 Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:43:34.254634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:43:34.256135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/7aa4ca550edd4876a4c6c56deedf9d70"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:43:34.256135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1362344250 Sep 06 04:43:34.256135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 7aa4ca550edd4876a4c6c56deedf9d70 Sep 06 04:43:34.256135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1362344250 Sep 06 04:43:34.256135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-ServerRescueNegativeTestJSON-1362344250-project Sep 06 04:43:34.256135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:43:34.256135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:43:34.256135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: dec1c17550b849dbadbc16e98530b455 Sep 06 04:43:34.256135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1362344250-project Sep 06 04:43:34.256135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:43:34.256135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance ed927594-12ef-48af-b170-5b88f8ecb0ec could not be found. Sep 06 04:43:34.256135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': 'ed927594-12ef-48af-b170-5b88f8ecb0ec'} Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed927594-12ef-48af-b170-5b88f8ecb0ec could not be found. Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:43:34.258024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed927594-12ef-48af-b170-5b88f8ecb0ec could not be found. Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed927594-12ef-48af-b170-5b88f8ecb0ec could not be found. Sep 06 04:43:34.259282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:43:34.260998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-31749bad-1a30-4201-9e22-89f6bcb96817 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] Returning 404 to user: Instance ed927594-12ef-48af-b170-5b88f8ecb0ec could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:43:34.260998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-31749bad-1a30-4201-9e22-89f6bcb96817 tempest-ServerRescueNegativeTestJSON-1362344250 tempest-ServerRescueNegativeTestJSON-1362344250-project] 10.222.0.30 "GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec" status: 404 len: 111 microversion: 2.1 time: 0.031649 Sep 06 04:43:34.260998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 429/880] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:34 2022] GET /compute/v2.1/servers/ed927594-12ef-48af-b170-5b88f8ecb0ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 04:43:34.276061 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d2a64fee-828a-4bd8-95db-83dce6ab2f6b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:34.285479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d2a64fee-828a-4bd8-95db-83dce6ab2f6b tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1547 microversion: 2.1 time: 0.160450 Sep 06 04:43:34.287372 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 452/881] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:34 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:34.308923 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3df687fd-8a54-4eef-9d67-a8a4657e62cc tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:34.314092 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3df687fd-8a54-4eef-9d67-a8a4657e62cc tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:34.314983 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3df687fd-8a54-4eef-9d67-a8a4657e62cc tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Searching by: {'deleted': False, 'project_id': '623b9f3be0f24e2ea1caea0798b30704'} {{(pid=127617) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 06 04:43:34.322385 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3df687fd-8a54-4eef-9d67-a8a4657e62cc tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:34.323302 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3df687fd-8a54-4eef-9d67-a8a4657e62cc tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:34.323738 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3df687fd-8a54-4eef-9d67-a8a4657e62cc tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:34.324470 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3df687fd-8a54-4eef-9d67-a8a4657e62cc tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:34.324926 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3df687fd-8a54-4eef-9d67-a8a4657e62cc tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:34.325373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3df687fd-8a54-4eef-9d67-a8a4657e62cc tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:34.417746 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.multi_cell_list [None req-3df687fd-8a54-4eef-9d67-a8a4657e62cc tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127617) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 06 04:43:34.515908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3df687fd-8a54-4eef-9d67-a8a4657e62cc tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210646 Sep 06 04:43:34.516715 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 430/882] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Sep 6 04:43:34 2022] GET /compute/v2.1/servers => generated 342 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:43:34.528438 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9da39569-7b55-47b0-8714-c6e162ff8d70 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:34.529132 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9da39569-7b55-47b0-8714-c6e162ff8d70 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:34.536011 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9da39569-7b55-47b0-8714-c6e162ff8d70 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:34.536498 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9da39569-7b55-47b0-8714-c6e162ff8d70 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:34.536940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9da39569-7b55-47b0-8714-c6e162ff8d70 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:34.537663 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9da39569-7b55-47b0-8714-c6e162ff8d70 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:34.538122 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9da39569-7b55-47b0-8714-c6e162ff8d70 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:34.538551 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9da39569-7b55-47b0-8714-c6e162ff8d70 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:34.666841 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8f3312ed-f3ea-4032-a07e-d7484a8bbf5d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:34.667499 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8f3312ed-f3ea-4032-a07e-d7484a8bbf5d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:34.673915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f3312ed-f3ea-4032-a07e-d7484a8bbf5d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:34.674405 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f3312ed-f3ea-4032-a07e-d7484a8bbf5d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:34.674840 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f3312ed-f3ea-4032-a07e-d7484a8bbf5d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:34.676125 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f3312ed-f3ea-4032-a07e-d7484a8bbf5d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:34.676581 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f3312ed-f3ea-4032-a07e-d7484a8bbf5d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:34.677039 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f3312ed-f3ea-4032-a07e-d7484a8bbf5d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:34.766136 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9da39569-7b55-47b0-8714-c6e162ff8d70 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:34.774301 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9da39569-7b55-47b0-8714-c6e162ff8d70 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1547 microversion: 2.1 time: 0.249866 Sep 06 04:43:34.776479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 453/883] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:34 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1547 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:34.815702 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8f3312ed-f3ea-4032-a07e-d7484a8bbf5d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:34.825399 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8f3312ed-f3ea-4032-a07e-d7484a8bbf5d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.161045 Sep 06 04:43:34.825399 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 431/884] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:34 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:43:35.847727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5ea1dfd9-d83a-4fa4-b0e6-6455165b3772 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:35.848340 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5ea1dfd9-d83a-4fa4-b0e6-6455165b3772 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:35.854823 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ea1dfd9-d83a-4fa4-b0e6-6455165b3772 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:35.855312 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ea1dfd9-d83a-4fa4-b0e6-6455165b3772 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:35.855744 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ea1dfd9-d83a-4fa4-b0e6-6455165b3772 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:35.856441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ea1dfd9-d83a-4fa4-b0e6-6455165b3772 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:35.856895 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ea1dfd9-d83a-4fa4-b0e6-6455165b3772 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:35.857335 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5ea1dfd9-d83a-4fa4-b0e6-6455165b3772 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:36.111739 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5ea1dfd9-d83a-4fa4-b0e6-6455165b3772 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:36.122875 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5ea1dfd9-d83a-4fa4-b0e6-6455165b3772 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.278873 Sep 06 04:43:36.140213 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 454/885] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:35 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:37.156011 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3a7136e2-ada2-45a8-8c5c-c769cfde7c0f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:37.156622 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3a7136e2-ada2-45a8-8c5c-c769cfde7c0f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:37.163363 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a7136e2-ada2-45a8-8c5c-c769cfde7c0f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:37.163852 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a7136e2-ada2-45a8-8c5c-c769cfde7c0f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:37.164294 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a7136e2-ada2-45a8-8c5c-c769cfde7c0f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:37.164984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a7136e2-ada2-45a8-8c5c-c769cfde7c0f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:37.165475 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a7136e2-ada2-45a8-8c5c-c769cfde7c0f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:37.165902 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3a7136e2-ada2-45a8-8c5c-c769cfde7c0f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:37.311812 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3a7136e2-ada2-45a8-8c5c-c769cfde7c0f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:37.321193 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3a7136e2-ada2-45a8-8c5c-c769cfde7c0f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.168745 Sep 06 04:43:37.323854 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 432/886] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:37 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:37.825739 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c358bd41-c9dd-475f-aa0d-3c3ba83326ea tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01da4474-33a7-4326-998c-2e02371915ec"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:37.828215 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c358bd41-c9dd-475f-aa0d-3c3ba83326ea tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:37.835697 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c358bd41-c9dd-475f-aa0d-3c3ba83326ea tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:37.836188 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c358bd41-c9dd-475f-aa0d-3c3ba83326ea tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:37.836644 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c358bd41-c9dd-475f-aa0d-3c3ba83326ea tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:37.837349 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c358bd41-c9dd-475f-aa0d-3c3ba83326ea tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:37.837812 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c358bd41-c9dd-475f-aa0d-3c3ba83326ea tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:37.838238 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c358bd41-c9dd-475f-aa0d-3c3ba83326ea tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:38.041847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-362e14c0-388f-491c-a590-8901853a5b26 req-797643c3-5165-4444-a965-8ada09865f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddad572e-12e1-4699-ba46-16c1ccb25704", "name": "network-vif-unplugged", "status": "completed", "tag": "784c9a84-7d0f-461b-810d-b0f2b91e1d43"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:38.062273 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-362e14c0-388f-491c-a590-8901853a5b26 req-797643c3-5165-4444-a965-8ada09865f2c service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:38.062849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-362e14c0-388f-491c-a590-8901853a5b26 req-797643c3-5165-4444-a965-8ada09865f2c service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:38.063450 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-362e14c0-388f-491c-a590-8901853a5b26 req-797643c3-5165-4444-a965-8ada09865f2c service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:38.077150 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-362e14c0-388f-491c-a590-8901853a5b26 req-797643c3-5165-4444-a965-8ada09865f2c service nova] Creating event network-vif-unplugged:784c9a84-7d0f-461b-810d-b0f2b91e1d43 for instance ddad572e-12e1-4699-ba46-16c1ccb25704 on hv-cinder-85600 Sep 06 04:43:38.086518 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-362e14c0-388f-491c-a590-8901853a5b26 req-797643c3-5165-4444-a965-8ada09865f2c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048561 Sep 06 04:43:38.087149 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 433/887] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:43:38.345090 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-98338f5d-6762-4928-a299-39f82a8f2750 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:38.345857 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-98338f5d-6762-4928-a299-39f82a8f2750 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:38.352819 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98338f5d-6762-4928-a299-39f82a8f2750 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:38.353339 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98338f5d-6762-4928-a299-39f82a8f2750 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:38.353764 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98338f5d-6762-4928-a299-39f82a8f2750 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:38.354470 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98338f5d-6762-4928-a299-39f82a8f2750 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:38.354921 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98338f5d-6762-4928-a299-39f82a8f2750 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:38.355341 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-98338f5d-6762-4928-a299-39f82a8f2750 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:38.510872 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-98338f5d-6762-4928-a299-39f82a8f2750 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:38.520114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-98338f5d-6762-4928-a299-39f82a8f2750 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1507 microversion: 2.1 time: 0.179627 Sep 06 04:43:38.523427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 434/888] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:38 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:43:38.544284 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-09e3f816-a870-45dc-aeee-f84f7b349d75 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:38.545111 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-09e3f816-a870-45dc-aeee-f84f7b349d75 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:38.557051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09e3f816-a870-45dc-aeee-f84f7b349d75 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:38.557597 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09e3f816-a870-45dc-aeee-f84f7b349d75 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:38.558008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09e3f816-a870-45dc-aeee-f84f7b349d75 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:38.558704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09e3f816-a870-45dc-aeee-f84f7b349d75 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:38.563033 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09e3f816-a870-45dc-aeee-f84f7b349d75 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:38.564468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-09e3f816-a870-45dc-aeee-f84f7b349d75 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:38.618069 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-09e3f816-a870-45dc-aeee-f84f7b349d75 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127617) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 04:43:38.821024 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c358bd41-c9dd-475f-aa0d-3c3ba83326ea tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "POST /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.002499 Sep 06 04:43:38.821838 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 455/889] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Sep 6 04:43:37 2022] POST /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/os-volume_attachments => generated 194 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:43:38.898203 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-09e3f816-a870-45dc-aeee-f84f7b349d75 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "POST /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704/action" status: 202 len: 0 microversion: 2.1 time: 0.356505 Sep 06 04:43:38.898203 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 435/890] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Sep 6 04:43:38 2022] POST /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 04:43:38.906400 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8c876515-ae2d-45a1-a4f9-6262ab2add80 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:38.907114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8c876515-ae2d-45a1-a4f9-6262ab2add80 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:38.913930 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c876515-ae2d-45a1-a4f9-6262ab2add80 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:38.914410 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c876515-ae2d-45a1-a4f9-6262ab2add80 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:38.915831 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c876515-ae2d-45a1-a4f9-6262ab2add80 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:38.916527 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c876515-ae2d-45a1-a4f9-6262ab2add80 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:38.917110 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c876515-ae2d-45a1-a4f9-6262ab2add80 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:38.917949 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c876515-ae2d-45a1-a4f9-6262ab2add80 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:39.051615 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8c876515-ae2d-45a1-a4f9-6262ab2add80 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:39.060685 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8c876515-ae2d-45a1-a4f9-6262ab2add80 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1515 microversion: 2.1 time: 0.158820 Sep 06 04:43:39.061787 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 456/891] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:38 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:40.088676 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8e17c8c8-46f6-4c5d-9cd9-c414ec845364 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:40.089282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8e17c8c8-46f6-4c5d-9cd9-c414ec845364 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:40.095183 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e17c8c8-46f6-4c5d-9cd9-c414ec845364 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:40.095775 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e17c8c8-46f6-4c5d-9cd9-c414ec845364 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:40.096209 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e17c8c8-46f6-4c5d-9cd9-c414ec845364 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:40.097562 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e17c8c8-46f6-4c5d-9cd9-c414ec845364 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:40.098013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e17c8c8-46f6-4c5d-9cd9-c414ec845364 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:40.098429 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8e17c8c8-46f6-4c5d-9cd9-c414ec845364 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:40.233386 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8e17c8c8-46f6-4c5d-9cd9-c414ec845364 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:40.241671 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8e17c8c8-46f6-4c5d-9cd9-c414ec845364 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1517 microversion: 2.1 time: 0.157365 Sep 06 04:43:40.242172 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 436/892] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:40 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:40.762506 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d8517394-440a-43ac-b831-5838d95e13fe tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] Action: 'create', calling method: .version_select at 0x7f3176402790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-758272642", "metadata": {"Type": "work"}}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:41.359971 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d8517394-440a-43ac-b831-5838d95e13fe tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.758149 Sep 06 04:43:41.360596 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 457/893] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Sep 6 04:43:40 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 759 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 06 04:43:41.374037 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4364cfa1-5602-4dc2-8ffb-7d8ee1dc6055 tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] Calling method '.version_select at 0x7f317645b670>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:41.384981 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0db60b6e-8cfd-4b78-9245-51da422f50a1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:41.385651 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0db60b6e-8cfd-4b78-9245-51da422f50a1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:41.391749 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0db60b6e-8cfd-4b78-9245-51da422f50a1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:41.392226 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0db60b6e-8cfd-4b78-9245-51da422f50a1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:41.392659 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0db60b6e-8cfd-4b78-9245-51da422f50a1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:41.393388 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0db60b6e-8cfd-4b78-9245-51da422f50a1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:41.393896 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0db60b6e-8cfd-4b78-9245-51da422f50a1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:41.394312 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0db60b6e-8cfd-4b78-9245-51da422f50a1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:41.426696 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4364cfa1-5602-4dc2-8ffb-7d8ee1dc6055 tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/240a7f75-0ba7-459b-b359-1e55b7846bae" status: 200 len: 352 microversion: 2.1 time: 0.056478 Sep 06 04:43:41.427542 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 458/894] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:43:41 2022] GET /compute/v2.1/os-volumes/240a7f75-0ba7-459b-b359-1e55b7846bae => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:43:41.532027 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0db60b6e-8cfd-4b78-9245-51da422f50a1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:41.541042 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0db60b6e-8cfd-4b78-9245-51da422f50a1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1517 microversion: 2.1 time: 0.279254 Sep 06 04:43:41.541658 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 437/895] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:41 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1517 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:43:42.442007 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-386c6cc0-dbcb-418f-a569-e3bb1b707d71 tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] Calling method '.version_select at 0x7f3176413f70>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:42.489541 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-386c6cc0-dbcb-418f-a569-e3bb1b707d71 tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/240a7f75-0ba7-459b-b359-1e55b7846bae" status: 200 len: 353 microversion: 2.1 time: 0.052258 Sep 06 04:43:42.490114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 459/896] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:43:42 2022] GET /compute/v2.1/os-volumes/240a7f75-0ba7-459b-b359-1e55b7846bae => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:43:42.505823 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d7b2f966-64ef-4600-ae16-37682576a7d8 tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] Calling method '.version_select at 0x7f31765b2e50>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:42.554249 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d7b2f966-64ef-4600-ae16-37682576a7d8 tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/240a7f75-0ba7-459b-b359-1e55b7846bae" status: 200 len: 353 microversion: 2.1 time: 0.052575 Sep 06 04:43:42.554813 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 438/897] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:43:42 2022] GET /compute/v2.1/os-volumes/240a7f75-0ba7-459b-b359-1e55b7846bae => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:43:42.564231 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9e4cfc8c-d996-4276-8359-2344b379052a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:42.564832 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9e4cfc8c-d996-4276-8359-2344b379052a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:42.572205 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e4cfc8c-d996-4276-8359-2344b379052a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:42.572690 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e4cfc8c-d996-4276-8359-2344b379052a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:42.573122 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e4cfc8c-d996-4276-8359-2344b379052a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:42.573259 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d48fbb4d-ff82-487a-bcef-6e04736781f1 tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] Calling method '.version_select at 0x7f3177dd4c10>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:42.573836 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e4cfc8c-d996-4276-8359-2344b379052a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:42.574276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e4cfc8c-d996-4276-8359-2344b379052a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:42.574693 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9e4cfc8c-d996-4276-8359-2344b379052a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:42.704963 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9e4cfc8c-d996-4276-8359-2344b379052a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:42.712729 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9e4cfc8c-d996-4276-8359-2344b379052a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1517 microversion: 2.1 time: 0.152586 Sep 06 04:43:42.713293 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 460/898] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:42 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:42.786091 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d48fbb4d-ff82-487a-bcef-6e04736781f1 tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/240a7f75-0ba7-459b-b359-1e55b7846bae" status: 202 len: 0 microversion: 2.1 time: 0.216550 Sep 06 04:43:42.786658 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 439/899] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Sep 6 04:43:42 2022] DELETE /compute/v2.1/os-volumes/240a7f75-0ba7-459b-b359-1e55b7846bae => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 06 04:43:42.794692 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-97bd0b6a-14cc-4ef1-8bca-1a309a830678 tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] Calling method '.version_select at 0x7f317645b670>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:42.842211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-97bd0b6a-14cc-4ef1-8bca-1a309a830678 tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/240a7f75-0ba7-459b-b359-1e55b7846bae" status: 200 len: 352 microversion: 2.1 time: 0.051225 Sep 06 04:43:42.842920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 461/900] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:43:42 2022] GET /compute/v2.1/os-volumes/240a7f75-0ba7-459b-b359-1e55b7846bae => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:43:43.736659 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-46cde417-19c6-4738-8d59-d1f86ccd57e3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:43.737225 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-46cde417-19c6-4738-8d59-d1f86ccd57e3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:43.745210 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46cde417-19c6-4738-8d59-d1f86ccd57e3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:43.745723 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46cde417-19c6-4738-8d59-d1f86ccd57e3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:43.746159 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46cde417-19c6-4738-8d59-d1f86ccd57e3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:43.746847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46cde417-19c6-4738-8d59-d1f86ccd57e3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:43.747291 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46cde417-19c6-4738-8d59-d1f86ccd57e3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:43.747705 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-46cde417-19c6-4738-8d59-d1f86ccd57e3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:43.856461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-50005d84-8f34-4bb1-817b-f190e323e348 tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] Calling method '.version_select at 0x7f3176413790>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:43.877492 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-46cde417-19c6-4738-8d59-d1f86ccd57e3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:43.884132 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-50005d84-8f34-4bb1-817b-f190e323e348 tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] HTTP exception thrown: Volume 240a7f75-0ba7-459b-b359-1e55b7846bae could not be found. Sep 06 04:43:43.885869 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-46cde417-19c6-4738-8d59-d1f86ccd57e3 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1517 microversion: 2.1 time: 0.153717 Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-50005d84-8f34-4bb1-817b-f190e323e348 tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] Request method failure captured: Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/os-volumes/240a7f75-0ba7-459b-b359-1e55b7846bae HTTP/1.1 Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs_8aqfrAz7zZ78fOR81U5f7K-qghFxeU5LsUMh4s955eBs0jGByggyetcNeCnAdrDJjA82wyVLVELiBBhucoRzlK-7oLXuM3pLJdYSzgBVsM3u63HW2B6vjLc1P1_K9cDtuoF5kXSdGA_yGiGCiN_TkWgXB6nq71EW1BFIJ9Gs236I Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: c1db46db3dbd47e4b1ad65aabcef17a2 Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesGetTestJSON-1016595080 Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:43:43.886198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:43:43.887566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c1db46db3dbd47e4b1ad65aabcef17a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c1db46db3dbd47e4b1ad65aabcef17a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c1db46db3dbd47e4b1ad65aabcef17a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c1db46db3dbd47e4b1ad65aabcef17a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:43:43.887566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesGetTestJSON-1016595080 Sep 06 04:43:43.887566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: c1db46db3dbd47e4b1ad65aabcef17a2 Sep 06 04:43:43.887566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesGetTestJSON-1016595080 Sep 06 04:43:43.887566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesGetTestJSON-1016595080-project Sep 06 04:43:43.887566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:43:43.887566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:43:43.887566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 29dbb618cef74598bfcde8f2c440cf82 Sep 06 04:43:43.887566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesGetTestJSON-1016595080-project Sep 06 04:43:43.887566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: Sep 06 04:43:43.887566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Volume 240a7f75-0ba7-459b-b359-1e55b7846bae could not be found. Sep 06 04:43:43.887566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '240a7f75-0ba7-459b-b359-1e55b7846bae'} Sep 06 04:43:43.887566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 240a7f75-0ba7-459b-b359-1e55b7846bae could not be found. (HTTP 404) (Request-ID: req-6dd5fcd4-f710-48c9-807e-8bc39648c22d) Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:43:43.888468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 04:43:43.889758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 240a7f75-0ba7-459b-b359-1e55b7846bae could not be found. Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 04:43:43.890980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:43:43.892175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 240a7f75-0ba7-459b-b359-1e55b7846bae could not be found. Sep 06 04:43:43.892175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:43:43.892175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:43:43.892175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:43:43.892175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:43:43.892175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:43:43.892175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:43:43.892175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:43:43.892175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:43:43.892175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 240a7f75-0ba7-459b-b359-1e55b7846bae could not be found. Sep 06 04:43:43.892175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:43:43.892859 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 440/901] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:43 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:43.893528 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-50005d84-8f34-4bb1-817b-f190e323e348 tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] Returning 404 to user: Volume 240a7f75-0ba7-459b-b359-1e55b7846bae could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:43:43.893528 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-50005d84-8f34-4bb1-817b-f190e323e348 tempest-VolumesGetTestJSON-1016595080 tempest-VolumesGetTestJSON-1016595080-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/240a7f75-0ba7-459b-b359-1e55b7846bae" status: 404 len: 109 microversion: 2.1 time: 0.035508 Sep 06 04:43:43.893528 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 462/902] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:43:43 2022] GET /compute/v2.1/os-volumes/240a7f75-0ba7-459b-b359-1e55b7846bae => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 04:43:44.909524 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2b6f21eb-b320-4872-a2ab-f4ea34e1f9ff tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:44.910163 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2b6f21eb-b320-4872-a2ab-f4ea34e1f9ff tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:44.912117 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:44.917397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2b6f21eb-b320-4872-a2ab-f4ea34e1f9ff tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:44.917875 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2b6f21eb-b320-4872-a2ab-f4ea34e1f9ff tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:44.918299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2b6f21eb-b320-4872-a2ab-f4ea34e1f9ff tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:44.918976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2b6f21eb-b320-4872-a2ab-f4ea34e1f9ff tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:44.919420 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2b6f21eb-b320-4872-a2ab-f4ea34e1f9ff tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:44.919834 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2b6f21eb-b320-4872-a2ab-f4ea34e1f9ff tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:45.052475 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2b6f21eb-b320-4872-a2ab-f4ea34e1f9ff tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:45.060381 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2b6f21eb-b320-4872-a2ab-f4ea34e1f9ff tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1517 microversion: 2.1 time: 0.155027 Sep 06 04:43:45.060941 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 441/903] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:44 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:46.085635 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bf545f38-13d8-457c-87ad-cec17ccc85ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:46.086301 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bf545f38-13d8-457c-87ad-cec17ccc85ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:46.092922 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf545f38-13d8-457c-87ad-cec17ccc85ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:46.093435 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf545f38-13d8-457c-87ad-cec17ccc85ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:46.093868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf545f38-13d8-457c-87ad-cec17ccc85ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:46.094545 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf545f38-13d8-457c-87ad-cec17ccc85ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:46.095412 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf545f38-13d8-457c-87ad-cec17ccc85ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:46.095840 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bf545f38-13d8-457c-87ad-cec17ccc85ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:46.235122 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bf545f38-13d8-457c-87ad-cec17ccc85ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:46.245082 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bf545f38-13d8-457c-87ad-cec17ccc85ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1517 microversion: 2.1 time: 0.163532 Sep 06 04:43:46.245082 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 463/904] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:46 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:47.267696 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b417bc9b-6cb9-483c-9e16-f039e790b5de tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:47.269381 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b417bc9b-6cb9-483c-9e16-f039e790b5de tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:47.277874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b417bc9b-6cb9-483c-9e16-f039e790b5de tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:47.279178 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b417bc9b-6cb9-483c-9e16-f039e790b5de tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:47.279314 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b417bc9b-6cb9-483c-9e16-f039e790b5de tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:47.280082 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b417bc9b-6cb9-483c-9e16-f039e790b5de tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:47.280736 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b417bc9b-6cb9-483c-9e16-f039e790b5de tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:47.281252 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b417bc9b-6cb9-483c-9e16-f039e790b5de tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:47.452789 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b417bc9b-6cb9-483c-9e16-f039e790b5de tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:47.465575 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b417bc9b-6cb9-483c-9e16-f039e790b5de tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1517 microversion: 2.1 time: 0.202104 Sep 06 04:43:47.466248 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 442/905] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:47 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:47.515035 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-41516ad6-c836-4593-825a-4b3245e15309 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:47.515650 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-41516ad6-c836-4593-825a-4b3245e15309 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:47.522266 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-41516ad6-c836-4593-825a-4b3245e15309 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:47.522749 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-41516ad6-c836-4593-825a-4b3245e15309 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:47.523188 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-41516ad6-c836-4593-825a-4b3245e15309 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:47.523878 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-41516ad6-c836-4593-825a-4b3245e15309 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:47.524337 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-41516ad6-c836-4593-825a-4b3245e15309 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:47.524759 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-41516ad6-c836-4593-825a-4b3245e15309 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:47.657235 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-41516ad6-c836-4593-825a-4b3245e15309 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:47.665683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-41516ad6-c836-4593-825a-4b3245e15309 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1593 microversion: 2.1 time: 0.154384 Sep 06 04:43:47.666191 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 464/906] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:47 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:48.490753 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3fb0e1ea-ae05-4fd8-b6e6-cbe74fc1e535 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:48.491451 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3fb0e1ea-ae05-4fd8-b6e6-cbe74fc1e535 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:48.497969 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fb0e1ea-ae05-4fd8-b6e6-cbe74fc1e535 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:48.498450 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fb0e1ea-ae05-4fd8-b6e6-cbe74fc1e535 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:48.498874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fb0e1ea-ae05-4fd8-b6e6-cbe74fc1e535 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:48.499653 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fb0e1ea-ae05-4fd8-b6e6-cbe74fc1e535 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:48.500249 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fb0e1ea-ae05-4fd8-b6e6-cbe74fc1e535 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:48.500666 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3fb0e1ea-ae05-4fd8-b6e6-cbe74fc1e535 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:48.521075 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:48.635342 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-3fb0e1ea-ae05-4fd8-b6e6-cbe74fc1e535 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:48.643215 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3fb0e1ea-ae05-4fd8-b6e6-cbe74fc1e535 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.156934 Sep 06 04:43:48.644643 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 443/907] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:48 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:49.668473 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-140e85f4-ecc8-48f4-a7a7-538590c6d1c8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:49.669057 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-140e85f4-ecc8-48f4-a7a7-538590c6d1c8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:49.675852 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-140e85f4-ecc8-48f4-a7a7-538590c6d1c8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:49.676334 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-140e85f4-ecc8-48f4-a7a7-538590c6d1c8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:49.676775 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-140e85f4-ecc8-48f4-a7a7-538590c6d1c8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:49.677511 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-140e85f4-ecc8-48f4-a7a7-538590c6d1c8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:49.677971 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-140e85f4-ecc8-48f4-a7a7-538590c6d1c8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:49.678393 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-140e85f4-ecc8-48f4-a7a7-538590c6d1c8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:49.898441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-140e85f4-ecc8-48f4-a7a7-538590c6d1c8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:49.902263 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:49.907328 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-140e85f4-ecc8-48f4-a7a7-538590c6d1c8 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.242853 Sep 06 04:43:49.907906 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 465/908] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:49 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:50.106360 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-3539a486-9729-4454-885d-de9980ffc556 req-b886990a-be64-419f-afe4-908ad1eb5392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6c1b505-babf-4fde-b18b-7d72d9cc0acc", "tag": "2a57860e-e2d2-4ede-943c-6db28a3cdf5a"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:50.117964 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-3539a486-9729-4454-885d-de9980ffc556 req-b886990a-be64-419f-afe4-908ad1eb5392 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:50.118436 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-3539a486-9729-4454-885d-de9980ffc556 req-b886990a-be64-419f-afe4-908ad1eb5392 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:50.119074 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-3539a486-9729-4454-885d-de9980ffc556 req-b886990a-be64-419f-afe4-908ad1eb5392 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:50.131790 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-3539a486-9729-4454-885d-de9980ffc556 req-b886990a-be64-419f-afe4-908ad1eb5392 service nova] Creating event network-changed:2a57860e-e2d2-4ede-943c-6db28a3cdf5a for instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc on hv-cinder-85600 Sep 06 04:43:50.136851 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-3539a486-9729-4454-885d-de9980ffc556 req-b886990a-be64-419f-afe4-908ad1eb5392 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034181 Sep 06 04:43:50.137464 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 444/909] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:43:50.931604 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b765d902-23ea-49d0-a7e1-bbcba668cff4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:50.932210 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b765d902-23ea-49d0-a7e1-bbcba668cff4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:50.939164 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b765d902-23ea-49d0-a7e1-bbcba668cff4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:50.939831 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b765d902-23ea-49d0-a7e1-bbcba668cff4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:50.940270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b765d902-23ea-49d0-a7e1-bbcba668cff4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:50.941162 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b765d902-23ea-49d0-a7e1-bbcba668cff4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:50.941642 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b765d902-23ea-49d0-a7e1-bbcba668cff4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:50.945451 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b765d902-23ea-49d0-a7e1-bbcba668cff4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:51.111214 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b765d902-23ea-49d0-a7e1-bbcba668cff4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:51.119337 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b765d902-23ea-49d0-a7e1-bbcba668cff4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.191935 Sep 06 04:43:51.121432 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 466/910] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:50 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:52.147895 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2435496c-37ff-4c81-8503-08e00939d8b4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:52.148752 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2435496c-37ff-4c81-8503-08e00939d8b4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:52.151899 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:52.158151 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2435496c-37ff-4c81-8503-08e00939d8b4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:52.158685 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2435496c-37ff-4c81-8503-08e00939d8b4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:52.159409 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2435496c-37ff-4c81-8503-08e00939d8b4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:52.160234 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2435496c-37ff-4c81-8503-08e00939d8b4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:52.160727 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2435496c-37ff-4c81-8503-08e00939d8b4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:52.161151 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2435496c-37ff-4c81-8503-08e00939d8b4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:52.298576 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2435496c-37ff-4c81-8503-08e00939d8b4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:52.307110 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2435496c-37ff-4c81-8503-08e00939d8b4 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.167303 Sep 06 04:43:52.307679 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 445/911] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:52 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:52.679803 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-adc53747-5a07-4edf-bf01-264d1fdbc038 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1245580827"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:52.680396 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-adc53747-5a07-4edf-bf01-264d1fdbc038 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:52.687206 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adc53747-5a07-4edf-bf01-264d1fdbc038 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:52.687693 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adc53747-5a07-4edf-bf01-264d1fdbc038 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:52.688130 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adc53747-5a07-4edf-bf01-264d1fdbc038 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:52.688818 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adc53747-5a07-4edf-bf01-264d1fdbc038 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:52.689272 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adc53747-5a07-4edf-bf01-264d1fdbc038 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:52.689725 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-adc53747-5a07-4edf-bf01-264d1fdbc038 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:52.824094 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.network.security_group_api [None req-adc53747-5a07-4edf-bf01-264d1fdbc038 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Adding security group 4ec43856-5c28-4762-b54f-d7dac9bb8dc5 to port 2a57860e-e2d2-4ede-943c-6db28a3cdf5a Sep 06 04:43:53.208847 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-adc53747-5a07-4edf-bf01-264d1fdbc038 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "POST /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/action" status: 202 len: 0 microversion: 2.1 time: 0.533708 Sep 06 04:43:53.209669 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 467/912] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Sep 6 04:43:52 2022] POST /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:43:53.217388 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b0b35993-4377-4f5f-99d4-d17c366c64de tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:53.217590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-2ec48db4-3b80-43b7-b775-bbcc79bf3c06 req-aa9ba61d-6efa-4607-8eb0-35529ea553c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6c1b505-babf-4fde-b18b-7d72d9cc0acc", "tag": "2a57860e-e2d2-4ede-943c-6db28a3cdf5a"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:43:53.218145 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b0b35993-4377-4f5f-99d4-d17c366c64de tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:53.225299 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0b35993-4377-4f5f-99d4-d17c366c64de tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:53.226048 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0b35993-4377-4f5f-99d4-d17c366c64de tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:53.226522 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0b35993-4377-4f5f-99d4-d17c366c64de tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:53.227223 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0b35993-4377-4f5f-99d4-d17c366c64de tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:53.227681 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0b35993-4377-4f5f-99d4-d17c366c64de tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:53.228110 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0b35993-4377-4f5f-99d4-d17c366c64de tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:53.229389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2ec48db4-3b80-43b7-b775-bbcc79bf3c06 req-aa9ba61d-6efa-4607-8eb0-35529ea553c0 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:53.229864 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2ec48db4-3b80-43b7-b775-bbcc79bf3c06 req-aa9ba61d-6efa-4607-8eb0-35529ea553c0 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:53.230290 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2ec48db4-3b80-43b7-b775-bbcc79bf3c06 req-aa9ba61d-6efa-4607-8eb0-35529ea553c0 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:53.242589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-2ec48db4-3b80-43b7-b775-bbcc79bf3c06 req-aa9ba61d-6efa-4607-8eb0-35529ea553c0 service nova] Creating event network-changed:2a57860e-e2d2-4ede-943c-6db28a3cdf5a for instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc on hv-cinder-85600 Sep 06 04:43:53.248062 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-2ec48db4-3b80-43b7-b775-bbcc79bf3c06 req-aa9ba61d-6efa-4607-8eb0-35529ea553c0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034719 Sep 06 04:43:53.252896 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 446/913] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:43:53.331658 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e46779b5-767f-416c-8ab2-ca38e161eac0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:53.332903 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e46779b5-767f-416c-8ab2-ca38e161eac0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:53.341175 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e46779b5-767f-416c-8ab2-ca38e161eac0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:53.341175 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e46779b5-767f-416c-8ab2-ca38e161eac0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:53.341175 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e46779b5-767f-416c-8ab2-ca38e161eac0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:53.341175 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e46779b5-767f-416c-8ab2-ca38e161eac0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:53.341662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e46779b5-767f-416c-8ab2-ca38e161eac0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:53.342060 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e46779b5-767f-416c-8ab2-ca38e161eac0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:53.385618 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b0b35993-4377-4f5f-99d4-d17c366c64de tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:53.394120 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b0b35993-4377-4f5f-99d4-d17c366c64de tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1640 microversion: 2.1 time: 0.180678 Sep 06 04:43:53.395329 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 468/914] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:53 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1640 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:53.478566 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e46779b5-767f-416c-8ab2-ca38e161eac0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:53.486189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e46779b5-767f-416c-8ab2-ca38e161eac0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.158745 Sep 06 04:43:53.486757 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 447/915] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:53 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:43:54.510415 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-63fce65c-39a5-4b4b-aa39-151d59f952ea tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:54.510974 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-63fce65c-39a5-4b4b-aa39-151d59f952ea tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:54.517426 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63fce65c-39a5-4b4b-aa39-151d59f952ea tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:54.517911 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63fce65c-39a5-4b4b-aa39-151d59f952ea tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:54.518353 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63fce65c-39a5-4b4b-aa39-151d59f952ea tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:54.519391 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63fce65c-39a5-4b4b-aa39-151d59f952ea tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:54.520055 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63fce65c-39a5-4b4b-aa39-151d59f952ea tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:54.520490 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-63fce65c-39a5-4b4b-aa39-151d59f952ea tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:54.661497 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-63fce65c-39a5-4b4b-aa39-151d59f952ea tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:54.671022 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-63fce65c-39a5-4b4b-aa39-151d59f952ea tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.164674 Sep 06 04:43:54.671870 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 469/916] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:54 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:55.694970 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f2f6d20e-eaab-4572-bd91-8fa567432ba0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:55.695568 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f2f6d20e-eaab-4572-bd91-8fa567432ba0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:55.702515 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2f6d20e-eaab-4572-bd91-8fa567432ba0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:55.702993 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2f6d20e-eaab-4572-bd91-8fa567432ba0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:55.703418 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2f6d20e-eaab-4572-bd91-8fa567432ba0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:55.704099 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2f6d20e-eaab-4572-bd91-8fa567432ba0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:55.704543 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2f6d20e-eaab-4572-bd91-8fa567432ba0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:55.704959 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f2f6d20e-eaab-4572-bd91-8fa567432ba0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:55.838216 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f2f6d20e-eaab-4572-bd91-8fa567432ba0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:55.846072 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f2f6d20e-eaab-4572-bd91-8fa567432ba0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.155047 Sep 06 04:43:55.846634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 448/917] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:55 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:56.868959 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-627aed98-bd7e-44bf-a0a8-40f2f1974b9d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:56.869587 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-627aed98-bd7e-44bf-a0a8-40f2f1974b9d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:56.876448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-627aed98-bd7e-44bf-a0a8-40f2f1974b9d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:56.876935 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-627aed98-bd7e-44bf-a0a8-40f2f1974b9d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:56.877410 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-627aed98-bd7e-44bf-a0a8-40f2f1974b9d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:56.878100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-627aed98-bd7e-44bf-a0a8-40f2f1974b9d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:56.878714 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-627aed98-bd7e-44bf-a0a8-40f2f1974b9d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:56.879115 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-627aed98-bd7e-44bf-a0a8-40f2f1974b9d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:57.011840 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-627aed98-bd7e-44bf-a0a8-40f2f1974b9d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:57.020067 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-627aed98-bd7e-44bf-a0a8-40f2f1974b9d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.154325 Sep 06 04:43:57.020797 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 470/918] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:56 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:58.044039 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fb76ada5-e82d-44dd-8ecf-4feb02657a45 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:58.044571 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fb76ada5-e82d-44dd-8ecf-4feb02657a45 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:58.051054 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb76ada5-e82d-44dd-8ecf-4feb02657a45 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:58.051574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb76ada5-e82d-44dd-8ecf-4feb02657a45 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:58.052003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb76ada5-e82d-44dd-8ecf-4feb02657a45 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:58.052678 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb76ada5-e82d-44dd-8ecf-4feb02657a45 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:58.053123 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb76ada5-e82d-44dd-8ecf-4feb02657a45 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:58.053569 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fb76ada5-e82d-44dd-8ecf-4feb02657a45 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:58.179329 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fb76ada5-e82d-44dd-8ecf-4feb02657a45 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:58.187190 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fb76ada5-e82d-44dd-8ecf-4feb02657a45 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.147045 Sep 06 04:43:58.187771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 449/919] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:58 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:43:59.211793 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cb0d2623-3eef-443e-9f7b-bd096f29b547 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:43:59.212451 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cb0d2623-3eef-443e-9f7b-bd096f29b547 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:43:59.215014 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=54 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:43:59.219691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb0d2623-3eef-443e-9f7b-bd096f29b547 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:59.220169 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb0d2623-3eef-443e-9f7b-bd096f29b547 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:59.220596 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb0d2623-3eef-443e-9f7b-bd096f29b547 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:59.221277 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb0d2623-3eef-443e-9f7b-bd096f29b547 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:43:59.221749 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb0d2623-3eef-443e-9f7b-bd096f29b547 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:43:59.222162 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cb0d2623-3eef-443e-9f7b-bd096f29b547 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:43:59.354099 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cb0d2623-3eef-443e-9f7b-bd096f29b547 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:43:59.361806 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cb0d2623-3eef-443e-9f7b-bd096f29b547 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.153728 Sep 06 04:43:59.362382 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 471/920] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:43:59 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:00.390407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c1dde860-9810-47bc-92cc-04e51a55672b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:00.391051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c1dde860-9810-47bc-92cc-04e51a55672b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:00.397943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1dde860-9810-47bc-92cc-04e51a55672b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:00.398431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1dde860-9810-47bc-92cc-04e51a55672b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:00.398873 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1dde860-9810-47bc-92cc-04e51a55672b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:00.399566 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1dde860-9810-47bc-92cc-04e51a55672b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:00.400055 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1dde860-9810-47bc-92cc-04e51a55672b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:00.400486 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c1dde860-9810-47bc-92cc-04e51a55672b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:00.535672 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c1dde860-9810-47bc-92cc-04e51a55672b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:00.543453 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c1dde860-9810-47bc-92cc-04e51a55672b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.157273 Sep 06 04:44:00.544014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 450/921] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:00 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:01.566910 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-284d7488-bef2-4dcf-979b-7b20e8d2a328 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:01.567532 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-284d7488-bef2-4dcf-979b-7b20e8d2a328 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:01.574861 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284d7488-bef2-4dcf-979b-7b20e8d2a328 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:01.575338 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284d7488-bef2-4dcf-979b-7b20e8d2a328 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:01.575775 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284d7488-bef2-4dcf-979b-7b20e8d2a328 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:01.576456 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284d7488-bef2-4dcf-979b-7b20e8d2a328 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:01.576913 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284d7488-bef2-4dcf-979b-7b20e8d2a328 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:01.577355 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284d7488-bef2-4dcf-979b-7b20e8d2a328 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:01.711840 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-284d7488-bef2-4dcf-979b-7b20e8d2a328 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:01.719500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-284d7488-bef2-4dcf-979b-7b20e8d2a328 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.156483 Sep 06 04:44:01.720072 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 472/922] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:01 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:02.743387 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7ab24567-5db4-4934-97d7-8085f741ef6d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:02.744000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7ab24567-5db4-4934-97d7-8085f741ef6d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:02.750841 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ab24567-5db4-4934-97d7-8085f741ef6d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:02.751353 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ab24567-5db4-4934-97d7-8085f741ef6d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:02.751794 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ab24567-5db4-4934-97d7-8085f741ef6d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:02.752556 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ab24567-5db4-4934-97d7-8085f741ef6d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:02.752985 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ab24567-5db4-4934-97d7-8085f741ef6d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:02.753358 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7ab24567-5db4-4934-97d7-8085f741ef6d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:02.888677 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7ab24567-5db4-4934-97d7-8085f741ef6d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:02.896516 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7ab24567-5db4-4934-97d7-8085f741ef6d tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.157431 Sep 06 04:44:02.897073 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 451/923] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:02 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:03.919772 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a8ac8fec-9881-410a-8ac3-4a09e7e989c6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:03.920412 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a8ac8fec-9881-410a-8ac3-4a09e7e989c6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:03.926897 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8ac8fec-9881-410a-8ac3-4a09e7e989c6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:03.928008 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8ac8fec-9881-410a-8ac3-4a09e7e989c6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:03.928478 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8ac8fec-9881-410a-8ac3-4a09e7e989c6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:03.929169 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8ac8fec-9881-410a-8ac3-4a09e7e989c6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:03.929651 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8ac8fec-9881-410a-8ac3-4a09e7e989c6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:03.930076 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8ac8fec-9881-410a-8ac3-4a09e7e989c6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:04.065007 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a8ac8fec-9881-410a-8ac3-4a09e7e989c6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:04.072900 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a8ac8fec-9881-410a-8ac3-4a09e7e989c6 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.156936 Sep 06 04:44:04.073513 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 473/924] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:03 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:05.095946 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a4b6c616-a627-447f-bade-0209754ae698 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:05.096554 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a4b6c616-a627-447f-bade-0209754ae698 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:05.103368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4b6c616-a627-447f-bade-0209754ae698 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:05.103849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4b6c616-a627-447f-bade-0209754ae698 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:05.104282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4b6c616-a627-447f-bade-0209754ae698 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:05.104964 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4b6c616-a627-447f-bade-0209754ae698 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:05.105438 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4b6c616-a627-447f-bade-0209754ae698 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:05.105888 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4b6c616-a627-447f-bade-0209754ae698 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:05.236921 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a4b6c616-a627-447f-bade-0209754ae698 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:05.245215 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a4b6c616-a627-447f-bade-0209754ae698 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.153147 Sep 06 04:44:05.245811 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 452/925] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:05 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:06.267920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2072ab99-cca1-4a4b-9e3b-8fa6a586c21f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:06.268531 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2072ab99-cca1-4a4b-9e3b-8fa6a586c21f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:06.275647 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2072ab99-cca1-4a4b-9e3b-8fa6a586c21f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:06.276133 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2072ab99-cca1-4a4b-9e3b-8fa6a586c21f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:06.276571 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2072ab99-cca1-4a4b-9e3b-8fa6a586c21f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:06.277260 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2072ab99-cca1-4a4b-9e3b-8fa6a586c21f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:06.277828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2072ab99-cca1-4a4b-9e3b-8fa6a586c21f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:06.278187 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2072ab99-cca1-4a4b-9e3b-8fa6a586c21f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:06.414945 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2072ab99-cca1-4a4b-9e3b-8fa6a586c21f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:06.422648 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2072ab99-cca1-4a4b-9e3b-8fa6a586c21f tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.158634 Sep 06 04:44:06.423258 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 474/926] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:06 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:07.447793 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e7525c81-ed81-409b-ab6d-74fc8b150362 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:07.448406 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e7525c81-ed81-409b-ab6d-74fc8b150362 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:07.455003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7525c81-ed81-409b-ab6d-74fc8b150362 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:07.455479 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7525c81-ed81-409b-ab6d-74fc8b150362 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:07.455910 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7525c81-ed81-409b-ab6d-74fc8b150362 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:07.456594 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7525c81-ed81-409b-ab6d-74fc8b150362 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:07.457043 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7525c81-ed81-409b-ab6d-74fc8b150362 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:07.457488 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e7525c81-ed81-409b-ab6d-74fc8b150362 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:07.593481 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e7525c81-ed81-409b-ab6d-74fc8b150362 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:07.602120 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e7525c81-ed81-409b-ab6d-74fc8b150362 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.158426 Sep 06 04:44:07.602700 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 453/927] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:07 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:08.625585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-114a5ba6-f988-48a0-880e-f1d252b961b2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:08.626185 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-114a5ba6-f988-48a0-880e-f1d252b961b2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:08.632626 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-114a5ba6-f988-48a0-880e-f1d252b961b2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:08.633106 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-114a5ba6-f988-48a0-880e-f1d252b961b2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:08.633574 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-114a5ba6-f988-48a0-880e-f1d252b961b2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:08.634276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-114a5ba6-f988-48a0-880e-f1d252b961b2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:08.634720 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-114a5ba6-f988-48a0-880e-f1d252b961b2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:08.635138 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-114a5ba6-f988-48a0-880e-f1d252b961b2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:08.762262 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-114a5ba6-f988-48a0-880e-f1d252b961b2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:08.769948 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-114a5ba6-f988-48a0-880e-f1d252b961b2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.148287 Sep 06 04:44:08.771035 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 475/928] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:08 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:09.222215 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-0211d7d3-532c-472b-9e99-1e7d74e97d62 req-08d9227b-eda0-4a39-b064-dfd3699a283e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddad572e-12e1-4699-ba46-16c1ccb25704", "name": "network-vif-plugged", "status": "completed", "tag": "784c9a84-7d0f-461b-810d-b0f2b91e1d43"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:44:09.234954 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0211d7d3-532c-472b-9e99-1e7d74e97d62 req-08d9227b-eda0-4a39-b064-dfd3699a283e service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:09.235430 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0211d7d3-532c-472b-9e99-1e7d74e97d62 req-08d9227b-eda0-4a39-b064-dfd3699a283e service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:09.235859 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0211d7d3-532c-472b-9e99-1e7d74e97d62 req-08d9227b-eda0-4a39-b064-dfd3699a283e service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:09.251938 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-0211d7d3-532c-472b-9e99-1e7d74e97d62 req-08d9227b-eda0-4a39-b064-dfd3699a283e service nova] Creating event network-vif-plugged:784c9a84-7d0f-461b-810d-b0f2b91e1d43 for instance ddad572e-12e1-4699-ba46-16c1ccb25704 on hv-cinder-85600 Sep 06 04:44:09.257957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-0211d7d3-532c-472b-9e99-1e7d74e97d62 req-08d9227b-eda0-4a39-b064-dfd3699a283e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039358 Sep 06 04:44:09.258565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 454/929] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:44:09.793893 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-61eca7d7-87f0-4867-8c89-6fb380f016ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:09.794490 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-61eca7d7-87f0-4867-8c89-6fb380f016ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:09.800724 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61eca7d7-87f0-4867-8c89-6fb380f016ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:09.804692 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61eca7d7-87f0-4867-8c89-6fb380f016ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:09.804692 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61eca7d7-87f0-4867-8c89-6fb380f016ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:09.804692 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61eca7d7-87f0-4867-8c89-6fb380f016ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:09.804692 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61eca7d7-87f0-4867-8c89-6fb380f016ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:09.805103 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61eca7d7-87f0-4867-8c89-6fb380f016ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:09.935498 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-61eca7d7-87f0-4867-8c89-6fb380f016ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:09.943162 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-61eca7d7-87f0-4867-8c89-6fb380f016ef tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.153074 Sep 06 04:44:09.943725 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 476/930] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:09 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:10.967041 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d02fef0c-547f-40d0-9dee-d12ce3587904 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:10.967676 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d02fef0c-547f-40d0-9dee-d12ce3587904 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:10.973763 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d02fef0c-547f-40d0-9dee-d12ce3587904 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:10.974397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d02fef0c-547f-40d0-9dee-d12ce3587904 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:10.974833 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d02fef0c-547f-40d0-9dee-d12ce3587904 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:10.975516 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d02fef0c-547f-40d0-9dee-d12ce3587904 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:10.975966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d02fef0c-547f-40d0-9dee-d12ce3587904 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:10.976393 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d02fef0c-547f-40d0-9dee-d12ce3587904 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:11.107932 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d02fef0c-547f-40d0-9dee-d12ce3587904 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:11.116166 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d02fef0c-547f-40d0-9dee-d12ce3587904 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.153932 Sep 06 04:44:11.116734 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 455/931] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:10 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:12.139989 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-024dad25-2f10-4b3b-8956-ea19c46e7437 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:12.140649 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-024dad25-2f10-4b3b-8956-ea19c46e7437 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:12.147437 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-024dad25-2f10-4b3b-8956-ea19c46e7437 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:12.147923 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-024dad25-2f10-4b3b-8956-ea19c46e7437 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:12.148356 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-024dad25-2f10-4b3b-8956-ea19c46e7437 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:12.151761 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-024dad25-2f10-4b3b-8956-ea19c46e7437 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:12.151761 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-024dad25-2f10-4b3b-8956-ea19c46e7437 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:12.151761 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-024dad25-2f10-4b3b-8956-ea19c46e7437 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:12.279412 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-024dad25-2f10-4b3b-8956-ea19c46e7437 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:12.287614 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-024dad25-2f10-4b3b-8956-ea19c46e7437 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.151525 Sep 06 04:44:12.288619 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 477/932] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:12 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:13.311461 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4bdf26e8-ca5c-426a-a1ae-60f2c10a7474 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:13.312380 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4bdf26e8-ca5c-426a-a1ae-60f2c10a7474 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:13.319543 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4bdf26e8-ca5c-426a-a1ae-60f2c10a7474 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:13.320029 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4bdf26e8-ca5c-426a-a1ae-60f2c10a7474 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:13.320458 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4bdf26e8-ca5c-426a-a1ae-60f2c10a7474 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:13.321144 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4bdf26e8-ca5c-426a-a1ae-60f2c10a7474 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:13.321628 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4bdf26e8-ca5c-426a-a1ae-60f2c10a7474 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:13.322051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4bdf26e8-ca5c-426a-a1ae-60f2c10a7474 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:13.453581 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4bdf26e8-ca5c-426a-a1ae-60f2c10a7474 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:13.461513 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4bdf26e8-ca5c-426a-a1ae-60f2c10a7474 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.153961 Sep 06 04:44:13.462080 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 456/933] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:13 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:14.484093 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3613a69b-6488-4b17-b6b6-9afe7f9f62fa tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:14.484724 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3613a69b-6488-4b17-b6b6-9afe7f9f62fa tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:14.492046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3613a69b-6488-4b17-b6b6-9afe7f9f62fa tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:14.495399 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3613a69b-6488-4b17-b6b6-9afe7f9f62fa tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:14.495399 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3613a69b-6488-4b17-b6b6-9afe7f9f62fa tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:14.495399 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3613a69b-6488-4b17-b6b6-9afe7f9f62fa tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:14.495399 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3613a69b-6488-4b17-b6b6-9afe7f9f62fa tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:14.495776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3613a69b-6488-4b17-b6b6-9afe7f9f62fa tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:14.625059 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3613a69b-6488-4b17-b6b6-9afe7f9f62fa tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:14.632736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3613a69b-6488-4b17-b6b6-9afe7f9f62fa tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.152510 Sep 06 04:44:14.633313 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 478/934] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:14 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:15.656268 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-da221f31-a64b-43b9-b2ad-a3303e08acd1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:15.656836 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-da221f31-a64b-43b9-b2ad-a3303e08acd1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:15.663839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-da221f31-a64b-43b9-b2ad-a3303e08acd1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:15.664384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-da221f31-a64b-43b9-b2ad-a3303e08acd1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:15.664820 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-da221f31-a64b-43b9-b2ad-a3303e08acd1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:15.665522 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-da221f31-a64b-43b9-b2ad-a3303e08acd1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:15.665966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-da221f31-a64b-43b9-b2ad-a3303e08acd1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:15.666412 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-da221f31-a64b-43b9-b2ad-a3303e08acd1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:15.803207 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-da221f31-a64b-43b9-b2ad-a3303e08acd1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:15.810988 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-da221f31-a64b-43b9-b2ad-a3303e08acd1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1573 microversion: 2.1 time: 0.158955 Sep 06 04:44:15.811554 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 457/935] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:15 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:16.835717 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0660bdad-cc72-4f18-8cc5-914a4636d1c2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:16.836317 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0660bdad-cc72-4f18-8cc5-914a4636d1c2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:16.842799 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0660bdad-cc72-4f18-8cc5-914a4636d1c2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:16.843278 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0660bdad-cc72-4f18-8cc5-914a4636d1c2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:16.843706 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0660bdad-cc72-4f18-8cc5-914a4636d1c2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:16.844377 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0660bdad-cc72-4f18-8cc5-914a4636d1c2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:16.844830 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0660bdad-cc72-4f18-8cc5-914a4636d1c2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:16.845246 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0660bdad-cc72-4f18-8cc5-914a4636d1c2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:16.975544 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0660bdad-cc72-4f18-8cc5-914a4636d1c2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:16.983188 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0660bdad-cc72-4f18-8cc5-914a4636d1c2 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1560 microversion: 2.1 time: 0.152048 Sep 06 04:44:16.983749 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 479/936] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:16 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:42.095745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7a04904f-a0e9-4891-a320-b82cf09ba988 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:42.096368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7a04904f-a0e9-4891-a320-b82cf09ba988 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:42.098565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=25 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:44:42.099217 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=74 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:44:42.104715 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a04904f-a0e9-4891-a320-b82cf09ba988 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:42.105201 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a04904f-a0e9-4891-a320-b82cf09ba988 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:42.105656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a04904f-a0e9-4891-a320-b82cf09ba988 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:42.106342 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a04904f-a0e9-4891-a320-b82cf09ba988 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:42.106860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a04904f-a0e9-4891-a320-b82cf09ba988 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:42.107298 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a04904f-a0e9-4891-a320-b82cf09ba988 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:42.136319 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7a04904f-a0e9-4891-a320-b82cf09ba988 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/ips" status: 200 len: 150 microversion: 2.1 time: 0.044503 Sep 06 04:44:42.137367 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 458/937] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Sep 6 04:44:42 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:44:44.777056 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3d24b4b9-2e43-4269-907a-0f9eeca95f9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d453fc53-b931-4843-a614-cd444c846ffb"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:44:44.779746 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3d24b4b9-2e43-4269-907a-0f9eeca95f9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:44.782064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=17 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:44:44.782741 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=82 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:44:44.787437 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d24b4b9-2e43-4269-907a-0f9eeca95f9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:44.787929 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d24b4b9-2e43-4269-907a-0f9eeca95f9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:44.788364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d24b4b9-2e43-4269-907a-0f9eeca95f9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:44.789655 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d24b4b9-2e43-4269-907a-0f9eeca95f9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:44.790235 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d24b4b9-2e43-4269-907a-0f9eeca95f9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:44.790665 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3d24b4b9-2e43-4269-907a-0f9eeca95f9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:45.514388 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3d24b4b9-2e43-4269-907a-0f9eeca95f9a tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "POST /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741196 Sep 06 04:44:45.515358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 480/938] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Sep 6 04:44:44 2022] POST /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:44:54.138049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0cc61e73-1c5b-4a4c-bc00-c3687eb02e83 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d453fc53-b931-4843-a614-cd444c846ffb"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:44:54.140458 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0cc61e73-1c5b-4a4c-bc00-c3687eb02e83 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:54.146693 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0cc61e73-1c5b-4a4c-bc00-c3687eb02e83 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:54.147175 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0cc61e73-1c5b-4a4c-bc00-c3687eb02e83 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:54.147612 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0cc61e73-1c5b-4a4c-bc00-c3687eb02e83 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:54.148303 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0cc61e73-1c5b-4a4c-bc00-c3687eb02e83 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:54.148759 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0cc61e73-1c5b-4a4c-bc00-c3687eb02e83 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:54.149231 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0cc61e73-1c5b-4a4c-bc00-c3687eb02e83 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:54.228697 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-0cc61e73-1c5b-4a4c-bc00-c3687eb02e83 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] HTTP exception thrown: Invalid volume: volume d453fc53-b931-4843-a614-cd444c846ffb is already attached to instances: 6059864b-289a-4aa6-85b9-9041ca7e9d2d Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0cc61e73-1c5b-4a4c-bc00-c3687eb02e83 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Request method failure captured: Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: POST /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/os-volume_attachments HTTP/1.1 Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 74 Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4RQ2W0jAEqmIc2a2gyZUln8p5bNCm0_mI8D5F27-XVkP7ATAOu468pXcxlEjqoKhC2riGskVgaopgp2mx1B-_JnDX9K5NgGMMIQuXdxY4mBudlKUObSTI_UiuCCeDA5-u77rF7VJ2ZfC_NCmQ-YCsbSULwwvYBOkysYcpX20qWbNI Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:44:54.230434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:44:54.232141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d04ba57221f42d684873d624dbfd283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:44:54.232141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:44:54.232141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:44:54.232141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:44:54.232141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:44:54.232141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:44:54.232141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:44:54.232141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 5a0294ea40914bf290902307a787642d Sep 06 04:44:54.232141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:44:54.232141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Sep 06 04:44:54.232141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {"volumeAttachment": {"volumeId": "d453fc53-b931-4843-a614-cd444c846ffb"}} Sep 06 04:44:54.232141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Invalid volume: volume d453fc53-b931-4843-a614-cd444c846ffb is already attached to instances: 6059864b-289a-4aa6-85b9-9041ca7e9d2d Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'server_id': '6059864b-289a-4aa6-85b9-9041ca7e9d2d', 'body': {'volumeAttachment': {'volumeId': 'd453fc53-b931-4843-a614-cd444c846ffb'}}} Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d453fc53-b931-4843-a614-cd444c846ffb is already attached to instances: 6059864b-289a-4aa6-85b9-9041ca7e9d2d Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:44:54.233114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d453fc53-b931-4843-a614-cd444c846ffb is already attached to instances: 6059864b-289a-4aa6-85b9-9041ca7e9d2d Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:44:54.234849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:44:54.236319 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:44:54.236319 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:44:54.236319 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:44:54.236319 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d453fc53-b931-4843-a614-cd444c846ffb is already attached to instances: 6059864b-289a-4aa6-85b9-9041ca7e9d2d Sep 06 04:44:54.236319 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:44:54.236319 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0cc61e73-1c5b-4a4c-bc00-c3687eb02e83 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Returning 400 to user: Invalid volume: volume d453fc53-b931-4843-a614-cd444c846ffb is already attached to instances: 6059864b-289a-4aa6-85b9-9041ca7e9d2d {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:44:54.236319 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0cc61e73-1c5b-4a4c-bc00-c3687eb02e83 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "POST /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098615 Sep 06 04:44:54.236319 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 459/939] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Sep 6 04:44:54 2022] POST /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 04:44:54.299750 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-27c0830a-2056-4924-9493-b6f5c7089599 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:54.300325 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-27c0830a-2056-4924-9493-b6f5c7089599 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:54.306956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27c0830a-2056-4924-9493-b6f5c7089599 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:54.307433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27c0830a-2056-4924-9493-b6f5c7089599 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:54.307863 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27c0830a-2056-4924-9493-b6f5c7089599 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:54.308539 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27c0830a-2056-4924-9493-b6f5c7089599 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:54.308987 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27c0830a-2056-4924-9493-b6f5c7089599 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:54.309432 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27c0830a-2056-4924-9493-b6f5c7089599 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:54.392843 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-27c0830a-2056-4924-9493-b6f5c7089599 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lazy-loading 'services' on Instance uuid 6059864b-289a-4aa6-85b9-9041ca7e9d2d {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:44:54.605858 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-27c0830a-2056-4924-9493-b6f5c7089599 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/os-volume_attachments/d453fc53-b931-4843-a614-cd444c846ffb" status: 202 len: 0 microversion: 2.1 time: 0.310092 Sep 06 04:44:54.606450 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 481/940] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Sep 6 04:44:54 2022] DELETE /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/os-volume_attachments/d453fc53-b931-4843-a614-cd444c846ffb => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:44:54.614857 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3c550fd7-f0ea-4392-8871-7d389fdb0f9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:54.616986 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3c550fd7-f0ea-4392-8871-7d389fdb0f9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:54.623738 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c550fd7-f0ea-4392-8871-7d389fdb0f9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:54.624217 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c550fd7-f0ea-4392-8871-7d389fdb0f9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:54.624649 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c550fd7-f0ea-4392-8871-7d389fdb0f9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:54.625356 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c550fd7-f0ea-4392-8871-7d389fdb0f9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:54.625804 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c550fd7-f0ea-4392-8871-7d389fdb0f9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:54.626225 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3c550fd7-f0ea-4392-8871-7d389fdb0f9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:54.655758 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3c550fd7-f0ea-4392-8871-7d389fdb0f9e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044808 Sep 06 04:44:54.656335 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 460/941] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:44:54 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:44:55.669529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-75d0afde-1e0a-46d4-897f-6de2a660f555 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:55.671855 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-75d0afde-1e0a-46d4-897f-6de2a660f555 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:55.677985 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75d0afde-1e0a-46d4-897f-6de2a660f555 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:55.678468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75d0afde-1e0a-46d4-897f-6de2a660f555 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:55.679358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75d0afde-1e0a-46d4-897f-6de2a660f555 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:55.680053 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75d0afde-1e0a-46d4-897f-6de2a660f555 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:55.680504 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75d0afde-1e0a-46d4-897f-6de2a660f555 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:55.680926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-75d0afde-1e0a-46d4-897f-6de2a660f555 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:55.712024 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-75d0afde-1e0a-46d4-897f-6de2a660f555 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047549 Sep 06 04:44:55.712921 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 482/942] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:44:55 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:44:56.724121 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b25e0562-a3a0-491f-be4e-a1c5179e2a4f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:56.726299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b25e0562-a3a0-491f-be4e-a1c5179e2a4f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:56.733379 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b25e0562-a3a0-491f-be4e-a1c5179e2a4f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:56.733870 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b25e0562-a3a0-491f-be4e-a1c5179e2a4f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:56.734306 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b25e0562-a3a0-491f-be4e-a1c5179e2a4f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:56.734998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b25e0562-a3a0-491f-be4e-a1c5179e2a4f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:56.735450 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b25e0562-a3a0-491f-be4e-a1c5179e2a4f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:56.735895 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b25e0562-a3a0-491f-be4e-a1c5179e2a4f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:56.768117 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b25e0562-a3a0-491f-be4e-a1c5179e2a4f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047926 Sep 06 04:44:56.768675 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 461/943] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:44:56 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 04:44:56.831280 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5a99daa5-2024-4207-bb29-7a0925b22584 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:56.835074 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5a99daa5-2024-4207-bb29-7a0925b22584 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:56.838476 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a99daa5-2024-4207-bb29-7a0925b22584 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:56.838970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a99daa5-2024-4207-bb29-7a0925b22584 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:56.839954 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a99daa5-2024-4207-bb29-7a0925b22584 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:56.840627 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a99daa5-2024-4207-bb29-7a0925b22584 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:56.841073 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a99daa5-2024-4207-bb29-7a0925b22584 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:56.841520 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a99daa5-2024-4207-bb29-7a0925b22584 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:56.867419 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5a99daa5-2024-4207-bb29-7a0925b22584 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:44:57.131696 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5a99daa5-2024-4207-bb29-7a0925b22584 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 204 len: 0 microversion: 2.1 time: 0.303964 Sep 06 04:44:57.132289 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 483/944] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:44:56 2022] DELETE /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:44:57.140999 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0c9fb6ce-ecc9-4efd-af5b-6412c6bec6eb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:57.141638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0c9fb6ce-ecc9-4efd-af5b-6412c6bec6eb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:57.147562 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c9fb6ce-ecc9-4efd-af5b-6412c6bec6eb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:57.148037 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c9fb6ce-ecc9-4efd-af5b-6412c6bec6eb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:57.148470 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c9fb6ce-ecc9-4efd-af5b-6412c6bec6eb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:57.149151 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c9fb6ce-ecc9-4efd-af5b-6412c6bec6eb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:57.149636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c9fb6ce-ecc9-4efd-af5b-6412c6bec6eb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:57.153231 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c9fb6ce-ecc9-4efd-af5b-6412c6bec6eb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:57.280959 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0c9fb6ce-ecc9-4efd-af5b-6412c6bec6eb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:57.288677 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0c9fb6ce-ecc9-4efd-af5b-6412c6bec6eb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1683 microversion: 2.1 time: 0.151450 Sep 06 04:44:57.289274 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 462/945] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:57 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:58.312539 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c9c8fcfd-3dfe-498c-a7e1-26a0bd2b90ca tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:58.313284 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c9c8fcfd-3dfe-498c-a7e1-26a0bd2b90ca tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:58.319894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9c8fcfd-3dfe-498c-a7e1-26a0bd2b90ca tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:58.320370 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9c8fcfd-3dfe-498c-a7e1-26a0bd2b90ca tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:58.320801 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9c8fcfd-3dfe-498c-a7e1-26a0bd2b90ca tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:58.321513 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9c8fcfd-3dfe-498c-a7e1-26a0bd2b90ca tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:58.321967 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9c8fcfd-3dfe-498c-a7e1-26a0bd2b90ca tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:58.322386 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c9c8fcfd-3dfe-498c-a7e1-26a0bd2b90ca tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:58.459331 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c9c8fcfd-3dfe-498c-a7e1-26a0bd2b90ca tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:58.467305 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c9c8fcfd-3dfe-498c-a7e1-26a0bd2b90ca tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1683 microversion: 2.1 time: 0.159040 Sep 06 04:44:58.467905 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 484/946] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:58 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:44:59.490495 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-179d78a1-a568-4fd2-ab69-fa81e131023e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:44:59.491162 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-179d78a1-a568-4fd2-ab69-fa81e131023e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:44:59.499064 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-179d78a1-a568-4fd2-ab69-fa81e131023e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:59.499557 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-179d78a1-a568-4fd2-ab69-fa81e131023e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:59.499996 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-179d78a1-a568-4fd2-ab69-fa81e131023e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:59.500700 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-179d78a1-a568-4fd2-ab69-fa81e131023e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:44:59.501155 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-179d78a1-a568-4fd2-ab69-fa81e131023e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:44:59.501607 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-179d78a1-a568-4fd2-ab69-fa81e131023e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:44:59.725057 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-179d78a1-a568-4fd2-ab69-fa81e131023e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:44:59.733043 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-179d78a1-a568-4fd2-ab69-fa81e131023e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1683 microversion: 2.1 time: 0.246590 Sep 06 04:44:59.744828 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 463/947] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:44:59 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1683 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:00.614703 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-20c5b2ae-4668-4eea-9e75-5d5b8098f1c5 req-068fcaa7-77f6-478e-a8fe-83a779c6e022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6059864b-289a-4aa6-85b9-9041ca7e9d2d", "name": "network-vif-deleted", "tag": "e194fb45-529b-4235-84c0-becbe4954bd3"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:00.625866 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-20c5b2ae-4668-4eea-9e75-5d5b8098f1c5 req-068fcaa7-77f6-478e-a8fe-83a779c6e022 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:00.626344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-20c5b2ae-4668-4eea-9e75-5d5b8098f1c5 req-068fcaa7-77f6-478e-a8fe-83a779c6e022 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:00.626967 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-20c5b2ae-4668-4eea-9e75-5d5b8098f1c5 req-068fcaa7-77f6-478e-a8fe-83a779c6e022 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:00.639082 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-20c5b2ae-4668-4eea-9e75-5d5b8098f1c5 req-068fcaa7-77f6-478e-a8fe-83a779c6e022 service nova] Creating event network-vif-deleted:e194fb45-529b-4235-84c0-becbe4954bd3 for instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d on hv-cinder-85600 Sep 06 04:45:00.644222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-20c5b2ae-4668-4eea-9e75-5d5b8098f1c5 req-068fcaa7-77f6-478e-a8fe-83a779c6e022 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033677 Sep 06 04:45:00.645388 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 485/948] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:45:00.756849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-db462468-1301-4e88-bea3-e2ac5f15bfb8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:00.757477 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-db462468-1301-4e88-bea3-e2ac5f15bfb8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:00.764804 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db462468-1301-4e88-bea3-e2ac5f15bfb8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:00.768534 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db462468-1301-4e88-bea3-e2ac5f15bfb8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:00.768534 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db462468-1301-4e88-bea3-e2ac5f15bfb8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:00.768534 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db462468-1301-4e88-bea3-e2ac5f15bfb8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:00.768534 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db462468-1301-4e88-bea3-e2ac5f15bfb8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:00.768938 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db462468-1301-4e88-bea3-e2ac5f15bfb8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:00.873865 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-db462468-1301-4e88-bea3-e2ac5f15bfb8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:00.882263 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-db462468-1301-4e88-bea3-e2ac5f15bfb8 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 200 len: 1327 microversion: 2.1 time: 0.129154 Sep 06 04:45:00.882823 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 464/949] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:00 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 1327 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:01.907882 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-70ab901d-b379-4ab0-805f-d63405632bb4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:01.908718 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-70ab901d-b379-4ab0-805f-d63405632bb4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:01.915043 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70ab901d-b379-4ab0-805f-d63405632bb4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:01.915530 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70ab901d-b379-4ab0-805f-d63405632bb4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:01.915973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70ab901d-b379-4ab0-805f-d63405632bb4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:01.916669 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70ab901d-b379-4ab0-805f-d63405632bb4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:01.917957 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70ab901d-b379-4ab0-805f-d63405632bb4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:01.918221 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70ab901d-b379-4ab0-805f-d63405632bb4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:01.932057 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-70ab901d-b379-4ab0-805f-d63405632bb4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] HTTP exception thrown: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-70ab901d-b379-4ab0-805f-d63405632bb4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Request method failure captured: Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d HTTP/1.1 Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs4RQ2W0jAEqmIc2a2gyZUln8p5bNCm0_mI8D5F27-XVkP7ATAOu468pXcxlEjqoKhC2riGskVgaopgp2mx1B-_JnDX9K5NgGMMIQuXdxY4mBudlKUObSTI_UiuCCeDA5-u77rF7VJ2ZfC_NCmQ-YCsbSULwwvYBOkysYcpX20qWbNI Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:45:01.934248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:45:01.935978 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d04ba57221f42d684873d624dbfd283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:45:01.935978 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:45:01.935978 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:45:01.935978 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:45:01.935978 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:45:01.935978 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:45:01.935978 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:45:01.935978 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 5a0294ea40914bf290902307a787642d Sep 06 04:45:01.935978 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:45:01.935978 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:45:01.935978 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. Sep 06 04:45:01.935978 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '6059864b-289a-4aa6-85b9-9041ca7e9d2d'} Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:45:01.936915 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. Sep 06 04:45:01.938487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:45:01.939878 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-70ab901d-b379-4ab0-805f-d63405632bb4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Returning 404 to user: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:45:01.939878 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-70ab901d-b379-4ab0-805f-d63405632bb4 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 404 len: 111 microversion: 2.1 time: 0.032836 Sep 06 04:45:01.939878 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 486/950] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:01 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:45:01.944576 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c2f0d3b3-acf3-474b-afcb-395502ee75bd tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '.version_select at 0x7f31767d2430>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:02.035940 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c2f0d3b3-acf3-474b-afcb-395502ee75bd tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240146963" status: 202 len: 0 microversion: 2.1 time: 0.095048 Sep 06 04:45:02.036558 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 465/951] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Sep 6 04:45:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240146963 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:45:02.875721 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-03cec22f-febd-4f5f-a4d7-9c2a3c55cb80 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Action: 'create', calling method: .version_select at 0x7f317645bf70>, body: {"keypair": {"name": "tempest-keypair-1502740357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbvvqmwAINyG4VC+Te8zgyu3CxLD6NF6mgn4AU0CuEcQ1y6mcGdB1OqwVHd1Gm4+kD/qCQDPaPrUBYQ1oSqRuZ++sOddhzKrt/vhwLZlrgqLs5aHoR69IaBgMn13q8wwg=="}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:02.892063 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-03cec22f-febd-4f5f-a4d7-9c2a3c55cb80 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for project 3d04ba57221f42d684873d624dbfd283. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:45:02.896055 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-03cec22f-febd-4f5f-a4d7-9c2a3c55cb80 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for user 5a0294ea40914bf290902307a787642d and project 3d04ba57221f42d684873d624dbfd283. Resources: {'key_pairs'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:45:02.979279 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-03cec22f-febd-4f5f-a4d7-9c2a3c55cb80 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107451 Sep 06 04:45:02.979844 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 487/952] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Sep 6 04:45:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:45:05.496240 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1888817703", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c394cea-216c-4a1f-9277-2bb67bf6a21b"}], "security_groups": [{"name": "tempest-securitygroup--1321124023"}], "key_name": "tempest-keypair-1502740357", "user_data": "}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:05.614325 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] validate_networks() for [('4c394cea-216c-4a1f-9277-2bb67bf6a21b', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:45:06.069446 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:45:06.069936 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:45:06.070438 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:45:06.070845 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:45:06.071374 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:45:06.080629 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:06.081128 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:06.081589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:06.082305 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:06.082753 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:06.083174 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:06.102058 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for project 3d04ba57221f42d684873d624dbfd283. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:45:06.106550 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Getting quotas for user 5a0294ea40914bf290902307a787642d and project 3d04ba57221f42d684873d624dbfd283. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:45:06.120890 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:45:06.123901 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:45:06.255546 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-edffc1c9-8861-46c3-972d-8269e0a5038d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.764659 Sep 06 04:45:06.256367 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 466/953] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:45:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:45:06.267922 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e2d9c72b-18b3-4ae8-ab1c-79edce4f75a9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:06.268458 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e2d9c72b-18b3-4ae8-ab1c-79edce4f75a9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:06.325223 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e2d9c72b-18b3-4ae8-ab1c-79edce4f75a9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:06.332108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e2d9c72b-18b3-4ae8-ab1c-79edce4f75a9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1242 microversion: 2.1 time: 0.068665 Sep 06 04:45:06.332673 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 488/954] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:06 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:07.356448 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-10af54d0-f04b-4115-b6ab-cd88a902fe17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:07.357053 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-10af54d0-f04b-4115-b6ab-cd88a902fe17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:07.364012 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10af54d0-f04b-4115-b6ab-cd88a902fe17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:07.364481 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10af54d0-f04b-4115-b6ab-cd88a902fe17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:07.364918 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10af54d0-f04b-4115-b6ab-cd88a902fe17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:07.365637 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10af54d0-f04b-4115-b6ab-cd88a902fe17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:07.366095 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10af54d0-f04b-4115-b6ab-cd88a902fe17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:07.366523 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-10af54d0-f04b-4115-b6ab-cd88a902fe17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:07.435410 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-10af54d0-f04b-4115-b6ab-cd88a902fe17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:07.443028 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-10af54d0-f04b-4115-b6ab-cd88a902fe17 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1246 microversion: 2.1 time: 0.091472 Sep 06 04:45:07.443587 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 467/955] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:07 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:07.781708 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1197589872", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "networks": [{"uuid": "3d3d4564-d0e1-4ed7-9376-767df6f5c221"}]}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:07.835504 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] validate_networks() for [('3d3d4564-d0e1-4ed7-9376-767df6f5c221', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:45:08.196156 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:45:08.196574 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:45:08.197045 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:45:08.197526 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:45:08.197932 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:45:08.207581 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:08.208051 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:08.208474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:08.209214 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:08.209698 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:08.210117 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:08.226197 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Getting quotas for project 5f758de124e64932af3cc80ed348f51c. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:45:08.230121 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Getting quotas for user 84150d0100be498b84f4b9a54525a986 and project 5f758de124e64932af3cc80ed348f51c. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:45:08.240905 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:45:08.243191 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:45:08.387265 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d33f9ac1-847f-48c3-8b16-6f045c0a514e tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609628 Sep 06 04:45:08.388022 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 489/956] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:45:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:45:08.399266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-93dd3972-b85b-4dbc-8fda-59e097b2c0bc tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:08.400178 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-93dd3972-b85b-4dbc-8fda-59e097b2c0bc tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:08.457421 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-93dd3972-b85b-4dbc-8fda-59e097b2c0bc tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:08.466323 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ff52c06e-bd85-4843-95b9-bdcfd8e1166e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:08.466930 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ff52c06e-bd85-4843-95b9-bdcfd8e1166e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:08.473457 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-93dd3972-b85b-4dbc-8fda-59e097b2c0bc tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1214 microversion: 2.1 time: 0.078047 Sep 06 04:45:08.474041 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 468/957] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:08 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:08.478643 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff52c06e-bd85-4843-95b9-bdcfd8e1166e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:08.479186 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff52c06e-bd85-4843-95b9-bdcfd8e1166e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:08.479715 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff52c06e-bd85-4843-95b9-bdcfd8e1166e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:08.480470 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff52c06e-bd85-4843-95b9-bdcfd8e1166e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:08.480982 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff52c06e-bd85-4843-95b9-bdcfd8e1166e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:08.481484 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ff52c06e-bd85-4843-95b9-bdcfd8e1166e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:08.547429 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ff52c06e-bd85-4843-95b9-bdcfd8e1166e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:08.558973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ff52c06e-bd85-4843-95b9-bdcfd8e1166e tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1294 microversion: 2.1 time: 0.093202 Sep 06 04:45:08.558973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 490/958] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:08 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:09.502661 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6bddddf6-cd8e-49a5-9c29-c0de81a6dc10 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:09.502661 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6bddddf6-cd8e-49a5-9c29-c0de81a6dc10 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:09.558159 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6bddddf6-cd8e-49a5-9c29-c0de81a6dc10 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:09.571359 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6bddddf6-cd8e-49a5-9c29-c0de81a6dc10 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1214 microversion: 2.1 time: 0.072370 Sep 06 04:45:09.571359 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 469/959] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:09 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:09.581133 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-87e20f08-bdd0-4ee2-baf4-d32b6646ebe9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:09.583352 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-87e20f08-bdd0-4ee2-baf4-d32b6646ebe9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:09.593635 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87e20f08-bdd0-4ee2-baf4-d32b6646ebe9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:09.594134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87e20f08-bdd0-4ee2-baf4-d32b6646ebe9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:09.594576 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87e20f08-bdd0-4ee2-baf4-d32b6646ebe9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:09.595286 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87e20f08-bdd0-4ee2-baf4-d32b6646ebe9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:09.595741 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87e20f08-bdd0-4ee2-baf4-d32b6646ebe9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:09.596380 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87e20f08-bdd0-4ee2-baf4-d32b6646ebe9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:09.741225 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-87e20f08-bdd0-4ee2-baf4-d32b6646ebe9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:09.749607 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-87e20f08-bdd0-4ee2-baf4-d32b6646ebe9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1368 microversion: 2.1 time: 0.172844 Sep 06 04:45:09.750190 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 491/960] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:09 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:10.414528 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-0b566d2c-da0a-4fd3-a90f-bb713e47f6a3 req-c0cab934-ec56-47b2-8d43-ab7c60534739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258d81b1-09b8-4462-88d2-c588852c8758", "tag": "99bb1003-b352-4698-b9a1-9dd6c82752f6"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:10.425035 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0b566d2c-da0a-4fd3-a90f-bb713e47f6a3 req-c0cab934-ec56-47b2-8d43-ab7c60534739 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:10.426577 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0b566d2c-da0a-4fd3-a90f-bb713e47f6a3 req-c0cab934-ec56-47b2-8d43-ab7c60534739 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:10.426577 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0b566d2c-da0a-4fd3-a90f-bb713e47f6a3 req-c0cab934-ec56-47b2-8d43-ab7c60534739 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:10.439054 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-0b566d2c-da0a-4fd3-a90f-bb713e47f6a3 req-c0cab934-ec56-47b2-8d43-ab7c60534739 service nova] Creating event network-changed:99bb1003-b352-4698-b9a1-9dd6c82752f6 for instance 258d81b1-09b8-4462-88d2-c588852c8758 on hv-cinder-85600 Sep 06 04:45:10.446008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-0b566d2c-da0a-4fd3-a90f-bb713e47f6a3 req-c0cab934-ec56-47b2-8d43-ab7c60534739 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035179 Sep 06 04:45:10.446622 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 470/961] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:45:10.590664 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-25f22510-a7d2-4388-a72d-ea1776b78c3a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:10.592038 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-25f22510-a7d2-4388-a72d-ea1776b78c3a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:10.599409 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-25f22510-a7d2-4388-a72d-ea1776b78c3a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:10.600083 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-25f22510-a7d2-4388-a72d-ea1776b78c3a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:10.610433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-25f22510-a7d2-4388-a72d-ea1776b78c3a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:10.610433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-25f22510-a7d2-4388-a72d-ea1776b78c3a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:10.610433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-25f22510-a7d2-4388-a72d-ea1776b78c3a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:10.610433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-25f22510-a7d2-4388-a72d-ea1776b78c3a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:10.672131 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-25f22510-a7d2-4388-a72d-ea1776b78c3a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:10.679985 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-25f22510-a7d2-4388-a72d-ea1776b78c3a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1266 microversion: 2.1 time: 0.094850 Sep 06 04:45:10.680570 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 492/962] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:10 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:10.774395 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2ab90397-8a23-430e-8cc4-bf4f60b63ee7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:10.775090 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2ab90397-8a23-430e-8cc4-bf4f60b63ee7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:10.782033 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ab90397-8a23-430e-8cc4-bf4f60b63ee7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:10.782526 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ab90397-8a23-430e-8cc4-bf4f60b63ee7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:10.782947 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ab90397-8a23-430e-8cc4-bf4f60b63ee7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:10.783628 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ab90397-8a23-430e-8cc4-bf4f60b63ee7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:10.784076 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ab90397-8a23-430e-8cc4-bf4f60b63ee7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:10.784496 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2ab90397-8a23-430e-8cc4-bf4f60b63ee7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:10.919818 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2ab90397-8a23-430e-8cc4-bf4f60b63ee7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:10.927635 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2ab90397-8a23-430e-8cc4-bf4f60b63ee7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1368 microversion: 2.1 time: 0.157803 Sep 06 04:45:10.928216 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 471/963] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:10 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:11.704510 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-97c834cf-8a8b-49f5-b5f2-2c3e762fcdce tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:11.705119 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-97c834cf-8a8b-49f5-b5f2-2c3e762fcdce tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:11.711854 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97c834cf-8a8b-49f5-b5f2-2c3e762fcdce tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:11.712350 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97c834cf-8a8b-49f5-b5f2-2c3e762fcdce tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:11.712762 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97c834cf-8a8b-49f5-b5f2-2c3e762fcdce tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:11.713488 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97c834cf-8a8b-49f5-b5f2-2c3e762fcdce tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:11.714625 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97c834cf-8a8b-49f5-b5f2-2c3e762fcdce tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:11.715081 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-97c834cf-8a8b-49f5-b5f2-2c3e762fcdce tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:11.786535 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-97c834cf-8a8b-49f5-b5f2-2c3e762fcdce tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:11.794810 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-97c834cf-8a8b-49f5-b5f2-2c3e762fcdce tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1272 microversion: 2.1 time: 0.094120 Sep 06 04:45:11.795372 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 493/964] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:11 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:11.950694 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e2b5f56f-c564-4e6c-9496-3f565a89a134 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:11.951315 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e2b5f56f-c564-4e6c-9496-3f565a89a134 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:11.959560 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2b5f56f-c564-4e6c-9496-3f565a89a134 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:11.960055 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2b5f56f-c564-4e6c-9496-3f565a89a134 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:11.960621 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2b5f56f-c564-4e6c-9496-3f565a89a134 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:11.961233 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2b5f56f-c564-4e6c-9496-3f565a89a134 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:11.961715 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2b5f56f-c564-4e6c-9496-3f565a89a134 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:11.962138 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e2b5f56f-c564-4e6c-9496-3f565a89a134 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:12.096000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e2b5f56f-c564-4e6c-9496-3f565a89a134 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:12.103665 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e2b5f56f-c564-4e6c-9496-3f565a89a134 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1368 microversion: 2.1 time: 0.156993 Sep 06 04:45:12.105144 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 472/965] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:11 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:12.817954 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-91c0a165-2b5f-4a0f-a11d-dc6acb186599 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:12.818560 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-91c0a165-2b5f-4a0f-a11d-dc6acb186599 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:12.825070 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91c0a165-2b5f-4a0f-a11d-dc6acb186599 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:12.825573 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91c0a165-2b5f-4a0f-a11d-dc6acb186599 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:12.826003 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91c0a165-2b5f-4a0f-a11d-dc6acb186599 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:12.826679 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91c0a165-2b5f-4a0f-a11d-dc6acb186599 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:12.827127 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91c0a165-2b5f-4a0f-a11d-dc6acb186599 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:12.827540 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91c0a165-2b5f-4a0f-a11d-dc6acb186599 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:12.951721 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-91c0a165-2b5f-4a0f-a11d-dc6acb186599 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:12.959291 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-91c0a165-2b5f-4a0f-a11d-dc6acb186599 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1314 microversion: 2.1 time: 0.145172 Sep 06 04:45:12.959883 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 494/966] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:12 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:13.128717 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8d3b6f60-9b96-4e6f-8b1c-8706a44e3f5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:13.129258 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8d3b6f60-9b96-4e6f-8b1c-8706a44e3f5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:13.136235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d3b6f60-9b96-4e6f-8b1c-8706a44e3f5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:13.136718 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d3b6f60-9b96-4e6f-8b1c-8706a44e3f5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:13.137152 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d3b6f60-9b96-4e6f-8b1c-8706a44e3f5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:13.137893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d3b6f60-9b96-4e6f-8b1c-8706a44e3f5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:13.138346 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d3b6f60-9b96-4e6f-8b1c-8706a44e3f5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:13.138769 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8d3b6f60-9b96-4e6f-8b1c-8706a44e3f5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:13.266639 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8d3b6f60-9b96-4e6f-8b1c-8706a44e3f5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:13.274293 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8d3b6f60-9b96-4e6f-8b1c-8706a44e3f5b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1368 microversion: 2.1 time: 0.149462 Sep 06 04:45:13.274867 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 473/967] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:13 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:13.983604 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-595d249b-4159-4b0d-bbcd-82db3ea2262a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:13.984217 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-595d249b-4159-4b0d-bbcd-82db3ea2262a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:13.990547 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-595d249b-4159-4b0d-bbcd-82db3ea2262a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:13.991034 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-595d249b-4159-4b0d-bbcd-82db3ea2262a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:13.991469 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-595d249b-4159-4b0d-bbcd-82db3ea2262a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:13.992161 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-595d249b-4159-4b0d-bbcd-82db3ea2262a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:13.992615 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-595d249b-4159-4b0d-bbcd-82db3ea2262a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:13.993035 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-595d249b-4159-4b0d-bbcd-82db3ea2262a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:14.187029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-595d249b-4159-4b0d-bbcd-82db3ea2262a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:14.194640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-595d249b-4159-4b0d-bbcd-82db3ea2262a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1314 microversion: 2.1 time: 0.215554 Sep 06 04:45:14.195202 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 495/968] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:13 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:14.298655 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-170a33cb-6a10-4d19-a0e3-4bc9caaf59f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:14.299357 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-170a33cb-6a10-4d19-a0e3-4bc9caaf59f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:14.305892 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-170a33cb-6a10-4d19-a0e3-4bc9caaf59f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:14.306370 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-170a33cb-6a10-4d19-a0e3-4bc9caaf59f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:14.306794 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-170a33cb-6a10-4d19-a0e3-4bc9caaf59f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:14.307511 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-170a33cb-6a10-4d19-a0e3-4bc9caaf59f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:14.307960 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-170a33cb-6a10-4d19-a0e3-4bc9caaf59f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:14.308367 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-170a33cb-6a10-4d19-a0e3-4bc9caaf59f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:14.454287 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-170a33cb-6a10-4d19-a0e3-4bc9caaf59f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:14.462272 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-170a33cb-6a10-4d19-a0e3-4bc9caaf59f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1368 microversion: 2.1 time: 0.167442 Sep 06 04:45:14.468956 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 474/969] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:14 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:14.667578 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-66443bd5-393d-446e-a9c7-4f66be11d868 req-18bd277b-ef2a-4bff-b819-d86f8676bf30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c82cee62-6001-47e4-bf3a-082527535ff5", "tag": "4c3904a7-3fe6-4dda-9cbc-88fa5b18e912"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:14.669775 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-66443bd5-393d-446e-a9c7-4f66be11d868 req-18bd277b-ef2a-4bff-b819-d86f8676bf30 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:14.670334 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-66443bd5-393d-446e-a9c7-4f66be11d868 req-18bd277b-ef2a-4bff-b819-d86f8676bf30 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:14.671132 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-66443bd5-393d-446e-a9c7-4f66be11d868 req-18bd277b-ef2a-4bff-b819-d86f8676bf30 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:14.684122 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-66443bd5-393d-446e-a9c7-4f66be11d868 req-18bd277b-ef2a-4bff-b819-d86f8676bf30 service nova] Creating event network-changed:4c3904a7-3fe6-4dda-9cbc-88fa5b18e912 for instance c82cee62-6001-47e4-bf3a-082527535ff5 on hv-cinder-85600 Sep 06 04:45:14.689702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-66443bd5-393d-446e-a9c7-4f66be11d868 req-18bd277b-ef2a-4bff-b819-d86f8676bf30 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036832 Sep 06 04:45:14.692506 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 496/970] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:45:15.219241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0fa87052-936f-4ac8-8de4-ae3780915e0d tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:15.219862 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0fa87052-936f-4ac8-8de4-ae3780915e0d tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:15.225976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fa87052-936f-4ac8-8de4-ae3780915e0d tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:15.226470 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fa87052-936f-4ac8-8de4-ae3780915e0d tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:15.226915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fa87052-936f-4ac8-8de4-ae3780915e0d tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:15.227622 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fa87052-936f-4ac8-8de4-ae3780915e0d tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:15.228130 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fa87052-936f-4ac8-8de4-ae3780915e0d tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:15.232174 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fa87052-936f-4ac8-8de4-ae3780915e0d tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:15.375374 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0fa87052-936f-4ac8-8de4-ae3780915e0d tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:15.389488 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0fa87052-936f-4ac8-8de4-ae3780915e0d tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1314 microversion: 2.1 time: 0.174091 Sep 06 04:45:15.390775 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 475/971] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:15 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:15.487018 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8c8a47ef-0a83-497f-8ee1-6d14b07937f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:15.487714 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8c8a47ef-0a83-497f-8ee1-6d14b07937f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:15.490452 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:15.495879 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c8a47ef-0a83-497f-8ee1-6d14b07937f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:15.496364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c8a47ef-0a83-497f-8ee1-6d14b07937f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:15.496797 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c8a47ef-0a83-497f-8ee1-6d14b07937f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:15.497523 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c8a47ef-0a83-497f-8ee1-6d14b07937f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:15.498260 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c8a47ef-0a83-497f-8ee1-6d14b07937f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:15.498709 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8c8a47ef-0a83-497f-8ee1-6d14b07937f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:15.501448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:15.714434 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8c8a47ef-0a83-497f-8ee1-6d14b07937f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:15.719377 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8c8a47ef-0a83-497f-8ee1-6d14b07937f5 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1368 microversion: 2.1 time: 0.236910 Sep 06 04:45:15.720083 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 497/972] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:15 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:16.413963 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-da4ae884-c476-4a93-9a1b-606854bd70a3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:16.414579 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-da4ae884-c476-4a93-9a1b-606854bd70a3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:16.416505 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:16.421835 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-da4ae884-c476-4a93-9a1b-606854bd70a3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:16.428054 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-da4ae884-c476-4a93-9a1b-606854bd70a3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:16.428054 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-da4ae884-c476-4a93-9a1b-606854bd70a3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:16.428054 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-da4ae884-c476-4a93-9a1b-606854bd70a3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:16.428054 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-da4ae884-c476-4a93-9a1b-606854bd70a3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:16.428478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-da4ae884-c476-4a93-9a1b-606854bd70a3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:16.559395 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-da4ae884-c476-4a93-9a1b-606854bd70a3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:16.566961 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-da4ae884-c476-4a93-9a1b-606854bd70a3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1314 microversion: 2.1 time: 0.156846 Sep 06 04:45:16.571500 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 476/973] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:16 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:16.742912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6a87f57a-d001-4681-bf3b-35fd8db88a81 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:16.743765 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6a87f57a-d001-4681-bf3b-35fd8db88a81 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:16.750685 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a87f57a-d001-4681-bf3b-35fd8db88a81 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:16.751196 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a87f57a-d001-4681-bf3b-35fd8db88a81 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:16.751623 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a87f57a-d001-4681-bf3b-35fd8db88a81 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:16.752305 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a87f57a-d001-4681-bf3b-35fd8db88a81 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:16.753030 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a87f57a-d001-4681-bf3b-35fd8db88a81 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:16.753486 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6a87f57a-d001-4681-bf3b-35fd8db88a81 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:16.879555 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6a87f57a-d001-4681-bf3b-35fd8db88a81 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:16.887023 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6a87f57a-d001-4681-bf3b-35fd8db88a81 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1368 microversion: 2.1 time: 0.148534 Sep 06 04:45:16.887577 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 498/974] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:16 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:17.591581 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-aa04f6e5-18c1-449b-943f-e04b47102364 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:17.592261 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-aa04f6e5-18c1-449b-943f-e04b47102364 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:17.598182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa04f6e5-18c1-449b-943f-e04b47102364 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:17.598701 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa04f6e5-18c1-449b-943f-e04b47102364 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:17.599500 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa04f6e5-18c1-449b-943f-e04b47102364 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:17.600129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa04f6e5-18c1-449b-943f-e04b47102364 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:17.600292 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa04f6e5-18c1-449b-943f-e04b47102364 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:17.600662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-aa04f6e5-18c1-449b-943f-e04b47102364 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:17.734695 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-aa04f6e5-18c1-449b-943f-e04b47102364 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:17.742567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-aa04f6e5-18c1-449b-943f-e04b47102364 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1314 microversion: 2.1 time: 0.155742 Sep 06 04:45:17.743140 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 477/975] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:17 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:17.786042 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-77b8241d-11a2-4ee6-8941-c5d755258c3f req-e9353041-ae18-4c08-bbdc-65d2bb4acd68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258d81b1-09b8-4462-88d2-c588852c8758", "name": "network-vif-plugged", "status": "completed", "tag": "99bb1003-b352-4698-b9a1-9dd6c82752f6"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:17.796099 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-77b8241d-11a2-4ee6-8941-c5d755258c3f req-e9353041-ae18-4c08-bbdc-65d2bb4acd68 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:17.796576 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-77b8241d-11a2-4ee6-8941-c5d755258c3f req-e9353041-ae18-4c08-bbdc-65d2bb4acd68 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:17.797032 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-77b8241d-11a2-4ee6-8941-c5d755258c3f req-e9353041-ae18-4c08-bbdc-65d2bb4acd68 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:17.808108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-77b8241d-11a2-4ee6-8941-c5d755258c3f req-e9353041-ae18-4c08-bbdc-65d2bb4acd68 service nova] Creating event network-vif-plugged:99bb1003-b352-4698-b9a1-9dd6c82752f6 for instance 258d81b1-09b8-4462-88d2-c588852c8758 on hv-cinder-85600 Sep 06 04:45:17.813052 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-77b8241d-11a2-4ee6-8941-c5d755258c3f req-e9353041-ae18-4c08-bbdc-65d2bb4acd68 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030576 Sep 06 04:45:17.813681 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 499/976] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:45:17.910663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b1824302-ad0c-4fb2-be30-aa61897e1c1f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:17.911188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b1824302-ad0c-4fb2-be30-aa61897e1c1f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:17.917353 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1824302-ad0c-4fb2-be30-aa61897e1c1f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:17.917834 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1824302-ad0c-4fb2-be30-aa61897e1c1f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:17.918273 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1824302-ad0c-4fb2-be30-aa61897e1c1f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:17.918967 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1824302-ad0c-4fb2-be30-aa61897e1c1f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:17.919422 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1824302-ad0c-4fb2-be30-aa61897e1c1f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:17.919843 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1824302-ad0c-4fb2-be30-aa61897e1c1f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:18.052733 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b1824302-ad0c-4fb2-be30-aa61897e1c1f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:18.060907 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b1824302-ad0c-4fb2-be30-aa61897e1c1f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1368 microversion: 2.1 time: 0.154185 Sep 06 04:45:18.061500 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 478/977] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:17 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:18.766229 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dac09bbe-765e-4207-9951-bb25e2d90d02 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:18.766974 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dac09bbe-765e-4207-9951-bb25e2d90d02 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:18.768936 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:18.769613 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=12 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:18.774781 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dac09bbe-765e-4207-9951-bb25e2d90d02 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:18.775263 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dac09bbe-765e-4207-9951-bb25e2d90d02 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:18.775715 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dac09bbe-765e-4207-9951-bb25e2d90d02 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:18.776515 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dac09bbe-765e-4207-9951-bb25e2d90d02 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:18.777005 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dac09bbe-765e-4207-9951-bb25e2d90d02 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:18.777453 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dac09bbe-765e-4207-9951-bb25e2d90d02 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:19.009846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-dac09bbe-765e-4207-9951-bb25e2d90d02 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:19.018022 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dac09bbe-765e-4207-9951-bb25e2d90d02 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1314 microversion: 2.1 time: 0.256686 Sep 06 04:45:19.018582 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 500/978] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:18 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:19.083870 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ffff8bb5-d5b8-4a1c-8426-18e6311b8c9f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:19.084478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ffff8bb5-d5b8-4a1c-8426-18e6311b8c9f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:19.091841 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ffff8bb5-d5b8-4a1c-8426-18e6311b8c9f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:19.092318 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ffff8bb5-d5b8-4a1c-8426-18e6311b8c9f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:19.092752 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ffff8bb5-d5b8-4a1c-8426-18e6311b8c9f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:19.093462 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ffff8bb5-d5b8-4a1c-8426-18e6311b8c9f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:19.093917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ffff8bb5-d5b8-4a1c-8426-18e6311b8c9f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:19.094337 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ffff8bb5-d5b8-4a1c-8426-18e6311b8c9f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:19.098507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:19.227313 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ffff8bb5-d5b8-4a1c-8426-18e6311b8c9f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:19.235320 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ffff8bb5-d5b8-4a1c-8426-18e6311b8c9f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1368 microversion: 2.1 time: 0.155249 Sep 06 04:45:19.235880 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 479/979] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:19 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:20.041371 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-898ddfca-1839-4bd6-86f1-8a7610ff30ab tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:20.041996 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-898ddfca-1839-4bd6-86f1-8a7610ff30ab tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:20.049815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-898ddfca-1839-4bd6-86f1-8a7610ff30ab tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:20.050306 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-898ddfca-1839-4bd6-86f1-8a7610ff30ab tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:20.050742 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-898ddfca-1839-4bd6-86f1-8a7610ff30ab tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:20.051438 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-898ddfca-1839-4bd6-86f1-8a7610ff30ab tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:20.051891 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-898ddfca-1839-4bd6-86f1-8a7610ff30ab tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:20.052314 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-898ddfca-1839-4bd6-86f1-8a7610ff30ab tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:20.187303 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-898ddfca-1839-4bd6-86f1-8a7610ff30ab tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:20.194861 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-898ddfca-1839-4bd6-86f1-8a7610ff30ab tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1314 microversion: 2.1 time: 0.157486 Sep 06 04:45:20.195425 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 501/980] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:20 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:20.263544 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e1d98877-61f5-4a11-8e55-d65c7c9b115f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:20.264166 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e1d98877-61f5-4a11-8e55-d65c7c9b115f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:20.266019 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=10 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:20.271147 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1d98877-61f5-4a11-8e55-d65c7c9b115f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:20.271619 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1d98877-61f5-4a11-8e55-d65c7c9b115f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:20.272043 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1d98877-61f5-4a11-8e55-d65c7c9b115f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:20.272715 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1d98877-61f5-4a11-8e55-d65c7c9b115f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:20.273174 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1d98877-61f5-4a11-8e55-d65c7c9b115f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:20.273621 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e1d98877-61f5-4a11-8e55-d65c7c9b115f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:20.401979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e1d98877-61f5-4a11-8e55-d65c7c9b115f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:20.418549 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e1d98877-61f5-4a11-8e55-d65c7c9b115f tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1368 microversion: 2.1 time: 0.152226 Sep 06 04:45:20.418549 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 480/981] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:20 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:21.218058 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b19c2380-4690-4e23-af19-21af60a5e832 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:21.218695 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b19c2380-4690-4e23-af19-21af60a5e832 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:21.225084 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b19c2380-4690-4e23-af19-21af60a5e832 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:21.225594 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b19c2380-4690-4e23-af19-21af60a5e832 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:21.226025 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b19c2380-4690-4e23-af19-21af60a5e832 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:21.226706 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b19c2380-4690-4e23-af19-21af60a5e832 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:21.227160 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b19c2380-4690-4e23-af19-21af60a5e832 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:21.227582 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b19c2380-4690-4e23-af19-21af60a5e832 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:21.435536 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-71fc249a-746c-4edc-82ee-315d03626be3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:21.436165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-71fc249a-746c-4edc-82ee-315d03626be3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:21.442559 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71fc249a-746c-4edc-82ee-315d03626be3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:21.443040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71fc249a-746c-4edc-82ee-315d03626be3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:21.443464 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71fc249a-746c-4edc-82ee-315d03626be3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:21.444148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71fc249a-746c-4edc-82ee-315d03626be3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:21.444594 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71fc249a-746c-4edc-82ee-315d03626be3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:21.445010 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-71fc249a-746c-4edc-82ee-315d03626be3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:21.524838 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b19c2380-4690-4e23-af19-21af60a5e832 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:21.533388 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b19c2380-4690-4e23-af19-21af60a5e832 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1314 microversion: 2.1 time: 0.319736 Sep 06 04:45:21.533967 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 502/982] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:21 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:21.603195 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-71fc249a-746c-4edc-82ee-315d03626be3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:21.611863 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-71fc249a-746c-4edc-82ee-315d03626be3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1559 microversion: 2.1 time: 0.180971 Sep 06 04:45:21.612623 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 481/983] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:21 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:21.633998 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-78966f2e-0016-42c2-b83d-26600465f3c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:21.634566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-78966f2e-0016-42c2-b83d-26600465f3c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:21.641578 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78966f2e-0016-42c2-b83d-26600465f3c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:21.642132 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78966f2e-0016-42c2-b83d-26600465f3c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:21.642630 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78966f2e-0016-42c2-b83d-26600465f3c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:21.643386 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78966f2e-0016-42c2-b83d-26600465f3c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:21.643905 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78966f2e-0016-42c2-b83d-26600465f3c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:21.644395 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-78966f2e-0016-42c2-b83d-26600465f3c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:21.728989 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-78966f2e-0016-42c2-b83d-26600465f3c3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098682 Sep 06 04:45:21.734073 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 503/984] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Sep 6 04:45:21 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:45:21.857397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-44138007-7f8d-486a-9028-d82e7240127f req-4c9af0d7-3b1b-4064-8eb8-8be0b0e28837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82cee62-6001-47e4-bf3a-082527535ff5", "name": "network-vif-plugged", "status": "completed", "tag": "4c3904a7-3fe6-4dda-9cbc-88fa5b18e912"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:21.867670 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-44138007-7f8d-486a-9028-d82e7240127f req-4c9af0d7-3b1b-4064-8eb8-8be0b0e28837 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:21.868218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-44138007-7f8d-486a-9028-d82e7240127f req-4c9af0d7-3b1b-4064-8eb8-8be0b0e28837 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:21.868736 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-44138007-7f8d-486a-9028-d82e7240127f req-4c9af0d7-3b1b-4064-8eb8-8be0b0e28837 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:21.879727 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-44138007-7f8d-486a-9028-d82e7240127f req-4c9af0d7-3b1b-4064-8eb8-8be0b0e28837 service nova] Creating event network-vif-plugged:4c3904a7-3fe6-4dda-9cbc-88fa5b18e912 for instance c82cee62-6001-47e4-bf3a-082527535ff5 on hv-cinder-85600 Sep 06 04:45:21.885037 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-44138007-7f8d-486a-9028-d82e7240127f req-4c9af0d7-3b1b-4064-8eb8-8be0b0e28837 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032795 Sep 06 04:45:21.885656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 482/985] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:45:22.067720 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a461a37f-b731-428e-80fa-ad7cfe9c7f19 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:22.070281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a461a37f-b731-428e-80fa-ad7cfe9c7f19 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:22.077684 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a461a37f-b731-428e-80fa-ad7cfe9c7f19 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:22.082995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a461a37f-b731-428e-80fa-ad7cfe9c7f19 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:22.082995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a461a37f-b731-428e-80fa-ad7cfe9c7f19 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:22.082995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a461a37f-b731-428e-80fa-ad7cfe9c7f19 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:22.082995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a461a37f-b731-428e-80fa-ad7cfe9c7f19 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:22.083519 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a461a37f-b731-428e-80fa-ad7cfe9c7f19 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:22.290107 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a461a37f-b731-428e-80fa-ad7cfe9c7f19 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "POST /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/action" status: 202 len: 0 microversion: 2.1 time: 0.226230 Sep 06 04:45:22.290786 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 504/986] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Sep 6 04:45:22 2022] POST /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:45:22.299453 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b6196627-de11-41a7-a084-dbc82cfbcec7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:22.300166 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b6196627-de11-41a7-a084-dbc82cfbcec7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:22.306617 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b6196627-de11-41a7-a084-dbc82cfbcec7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:22.307050 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b6196627-de11-41a7-a084-dbc82cfbcec7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:22.307492 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b6196627-de11-41a7-a084-dbc82cfbcec7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:22.308198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b6196627-de11-41a7-a084-dbc82cfbcec7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:22.308687 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b6196627-de11-41a7-a084-dbc82cfbcec7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:22.309110 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b6196627-de11-41a7-a084-dbc82cfbcec7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:22.475961 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b6196627-de11-41a7-a084-dbc82cfbcec7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:22.485929 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b6196627-de11-41a7-a084-dbc82cfbcec7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1751 microversion: 2.1 time: 0.190634 Sep 06 04:45:22.486535 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 483/987] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:22 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:22.557064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-70a4a51d-c214-4a25-b3a3-430771408043 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:22.557789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-70a4a51d-c214-4a25-b3a3-430771408043 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:22.564240 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70a4a51d-c214-4a25-b3a3-430771408043 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:22.564727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70a4a51d-c214-4a25-b3a3-430771408043 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:22.565169 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70a4a51d-c214-4a25-b3a3-430771408043 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:22.565902 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70a4a51d-c214-4a25-b3a3-430771408043 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:22.566360 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70a4a51d-c214-4a25-b3a3-430771408043 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:22.571704 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-70a4a51d-c214-4a25-b3a3-430771408043 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:22.753611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-70a4a51d-c214-4a25-b3a3-430771408043 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:22.761351 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-70a4a51d-c214-4a25-b3a3-430771408043 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1314 microversion: 2.1 time: 0.208524 Sep 06 04:45:22.762461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 505/988] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:22 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:22.859900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-2a40c1d3-7aa5-4770-b89e-bfd436f8e266 req-b4400e5e-0297-43c6-a7ef-6f35f6d7ac5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "258d81b1-09b8-4462-88d2-c588852c8758", "tag": "99bb1003-b352-4698-b9a1-9dd6c82752f6"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:22.869446 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2a40c1d3-7aa5-4770-b89e-bfd436f8e266 req-b4400e5e-0297-43c6-a7ef-6f35f6d7ac5e service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:22.870004 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2a40c1d3-7aa5-4770-b89e-bfd436f8e266 req-b4400e5e-0297-43c6-a7ef-6f35f6d7ac5e service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:22.870503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-2a40c1d3-7aa5-4770-b89e-bfd436f8e266 req-b4400e5e-0297-43c6-a7ef-6f35f6d7ac5e service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:22.882090 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-2a40c1d3-7aa5-4770-b89e-bfd436f8e266 req-b4400e5e-0297-43c6-a7ef-6f35f6d7ac5e service nova] Creating event network-changed:99bb1003-b352-4698-b9a1-9dd6c82752f6 for instance 258d81b1-09b8-4462-88d2-c588852c8758 on hv-cinder-85600 Sep 06 04:45:22.887968 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-2a40c1d3-7aa5-4770-b89e-bfd436f8e266 req-b4400e5e-0297-43c6-a7ef-6f35f6d7ac5e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031315 Sep 06 04:45:22.888294 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 484/989] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:45:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:45:23.510970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6451f766-b2bf-422c-9031-be62002bdb6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:23.511576 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6451f766-b2bf-422c-9031-be62002bdb6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:23.519969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6451f766-b2bf-422c-9031-be62002bdb6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:23.520707 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6451f766-b2bf-422c-9031-be62002bdb6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:23.521340 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6451f766-b2bf-422c-9031-be62002bdb6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:23.522218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6451f766-b2bf-422c-9031-be62002bdb6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:23.522981 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6451f766-b2bf-422c-9031-be62002bdb6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:23.523561 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6451f766-b2bf-422c-9031-be62002bdb6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:23.760194 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6451f766-b2bf-422c-9031-be62002bdb6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:23.769582 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6451f766-b2bf-422c-9031-be62002bdb6f tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1751 microversion: 2.1 time: 0.262558 Sep 06 04:45:23.770164 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 506/990] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:23 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1751 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:23.786664 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6b59dbfe-c5fa-43f2-b5e7-4df80f1f96ee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:23.787371 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6b59dbfe-c5fa-43f2-b5e7-4df80f1f96ee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:23.795418 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b59dbfe-c5fa-43f2-b5e7-4df80f1f96ee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:23.796042 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b59dbfe-c5fa-43f2-b5e7-4df80f1f96ee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:23.796580 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b59dbfe-c5fa-43f2-b5e7-4df80f1f96ee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:23.797457 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b59dbfe-c5fa-43f2-b5e7-4df80f1f96ee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:23.798032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b59dbfe-c5fa-43f2-b5e7-4df80f1f96ee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:23.798558 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6b59dbfe-c5fa-43f2-b5e7-4df80f1f96ee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:24.014469 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6b59dbfe-c5fa-43f2-b5e7-4df80f1f96ee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:24.022376 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6b59dbfe-c5fa-43f2-b5e7-4df80f1f96ee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1314 microversion: 2.1 time: 0.240324 Sep 06 04:45:24.024636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 485/991] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:23 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:24.794337 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1f83664c-5e6c-47f9-a4a0-d019555c6e03 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:24.794924 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1f83664c-5e6c-47f9-a4a0-d019555c6e03 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:24.801792 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f83664c-5e6c-47f9-a4a0-d019555c6e03 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:24.802279 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f83664c-5e6c-47f9-a4a0-d019555c6e03 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:24.802713 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f83664c-5e6c-47f9-a4a0-d019555c6e03 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:24.803490 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f83664c-5e6c-47f9-a4a0-d019555c6e03 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:24.804167 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f83664c-5e6c-47f9-a4a0-d019555c6e03 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:24.804358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f83664c-5e6c-47f9-a4a0-d019555c6e03 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:24.955733 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1f83664c-5e6c-47f9-a4a0-d019555c6e03 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:24.964021 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1f83664c-5e6c-47f9-a4a0-d019555c6e03 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.174692 Sep 06 04:45:24.964588 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 507/992] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:24 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:25.046578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0684604c-b53d-4520-8e60-19e4b6f51ccb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:25.047110 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0684604c-b53d-4520-8e60-19e4b6f51ccb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:25.049550 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:25.054248 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0684604c-b53d-4520-8e60-19e4b6f51ccb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:25.054725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0684604c-b53d-4520-8e60-19e4b6f51ccb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:25.055156 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0684604c-b53d-4520-8e60-19e4b6f51ccb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:25.055845 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0684604c-b53d-4520-8e60-19e4b6f51ccb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:25.056324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0684604c-b53d-4520-8e60-19e4b6f51ccb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:25.056742 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0684604c-b53d-4520-8e60-19e4b6f51ccb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:25.189787 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0684604c-b53d-4520-8e60-19e4b6f51ccb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:25.197562 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0684604c-b53d-4520-8e60-19e4b6f51ccb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1498 microversion: 2.1 time: 0.155281 Sep 06 04:45:25.198130 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 486/993] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:25 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1498 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:25.987956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0eb7c911-2340-447c-b38e-19f06a89ca54 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:25.988594 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0eb7c911-2340-447c-b38e-19f06a89ca54 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:25.995202 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0eb7c911-2340-447c-b38e-19f06a89ca54 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:25.995709 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0eb7c911-2340-447c-b38e-19f06a89ca54 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:25.996227 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0eb7c911-2340-447c-b38e-19f06a89ca54 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:25.996920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0eb7c911-2340-447c-b38e-19f06a89ca54 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:25.997751 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0eb7c911-2340-447c-b38e-19f06a89ca54 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:25.998234 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0eb7c911-2340-447c-b38e-19f06a89ca54 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:26.090202 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-3257aecc-b15e-4191-b6ae-9f8ebd8b3467 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:26.090814 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3257aecc-b15e-4191-b6ae-9f8ebd8b3467 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:26.097940 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3257aecc-b15e-4191-b6ae-9f8ebd8b3467 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:26.098423 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3257aecc-b15e-4191-b6ae-9f8ebd8b3467 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:26.098855 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3257aecc-b15e-4191-b6ae-9f8ebd8b3467 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:26.099551 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3257aecc-b15e-4191-b6ae-9f8ebd8b3467 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:26.099999 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3257aecc-b15e-4191-b6ae-9f8ebd8b3467 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:26.100415 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-3257aecc-b15e-4191-b6ae-9f8ebd8b3467 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:26.129980 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-3257aecc-b15e-4191-b6ae-9f8ebd8b3467 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:45:26.376062 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0eb7c911-2340-447c-b38e-19f06a89ca54 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:26.387628 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0eb7c911-2340-447c-b38e-19f06a89ca54 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.403613 Sep 06 04:45:26.388776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 508/994] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:25 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:26.407496 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-3257aecc-b15e-4191-b6ae-9f8ebd8b3467 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 204 len: 0 microversion: 2.1 time: 0.320931 Sep 06 04:45:26.408109 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 487/995] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:45:26 2022] DELETE /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 04:45:26.416222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-443f77b9-d675-4265-b60a-75336074454a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:26.416834 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-443f77b9-d675-4265-b60a-75336074454a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:26.423607 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-443f77b9-d675-4265-b60a-75336074454a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:26.424092 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-443f77b9-d675-4265-b60a-75336074454a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:26.426035 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-443f77b9-d675-4265-b60a-75336074454a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:26.426035 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-443f77b9-d675-4265-b60a-75336074454a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:26.426035 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-443f77b9-d675-4265-b60a-75336074454a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:26.426341 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-443f77b9-d675-4265-b60a-75336074454a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:26.554637 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-443f77b9-d675-4265-b60a-75336074454a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:26.562973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-443f77b9-d675-4265-b60a-75336074454a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1504 microversion: 2.1 time: 0.150541 Sep 06 04:45:26.563535 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 509/996] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:26 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:27.413547 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fcf9803c-54b8-4558-9a83-a853737de9e1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:27.414251 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fcf9803c-54b8-4558-9a83-a853737de9e1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:27.421382 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fcf9803c-54b8-4558-9a83-a853737de9e1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:27.421890 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fcf9803c-54b8-4558-9a83-a853737de9e1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:27.422322 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fcf9803c-54b8-4558-9a83-a853737de9e1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:27.423007 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fcf9803c-54b8-4558-9a83-a853737de9e1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:27.423457 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fcf9803c-54b8-4558-9a83-a853737de9e1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:27.423877 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fcf9803c-54b8-4558-9a83-a853737de9e1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:27.563466 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fcf9803c-54b8-4558-9a83-a853737de9e1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:27.571724 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fcf9803c-54b8-4558-9a83-a853737de9e1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.162398 Sep 06 04:45:27.572289 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 488/997] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:27 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:27.585248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-83cf4b49-6a7f-4455-90fb-ba05a2253cc3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:27.586006 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-83cf4b49-6a7f-4455-90fb-ba05a2253cc3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:27.593048 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83cf4b49-6a7f-4455-90fb-ba05a2253cc3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:27.593559 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83cf4b49-6a7f-4455-90fb-ba05a2253cc3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:27.593993 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83cf4b49-6a7f-4455-90fb-ba05a2253cc3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:27.594703 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83cf4b49-6a7f-4455-90fb-ba05a2253cc3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:27.595155 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83cf4b49-6a7f-4455-90fb-ba05a2253cc3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:27.595600 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-83cf4b49-6a7f-4455-90fb-ba05a2253cc3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:27.725142 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-83cf4b49-6a7f-4455-90fb-ba05a2253cc3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:27.733697 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-83cf4b49-6a7f-4455-90fb-ba05a2253cc3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1504 microversion: 2.1 time: 0.152150 Sep 06 04:45:27.734275 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 510/998] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:27 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:28.443176 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-31dd317b-e913-4287-9ebc-daa7d738cdda tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:28.443710 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-31dd317b-e913-4287-9ebc-daa7d738cdda tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:28.450140 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31dd317b-e913-4287-9ebc-daa7d738cdda tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:28.451166 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31dd317b-e913-4287-9ebc-daa7d738cdda tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:28.451597 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31dd317b-e913-4287-9ebc-daa7d738cdda tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:28.452276 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31dd317b-e913-4287-9ebc-daa7d738cdda tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:28.452721 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31dd317b-e913-4287-9ebc-daa7d738cdda tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:28.453135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-31dd317b-e913-4287-9ebc-daa7d738cdda tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:28.475331 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-31dd317b-e913-4287-9ebc-daa7d738cdda tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244/ips" status: 200 len: 153 microversion: 2.20 time: 0.036033 Sep 06 04:45:28.475890 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 489/999] 10.222.0.30 () {60 vars in 1289 bytes} [Tue Sep 6 04:45:28 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244/ips => generated 153 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:45:28.594993 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-61b9cbc2-a4d6-4290-95dc-e59a8b3d4803 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:28.595599 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-61b9cbc2-a4d6-4290-95dc-e59a8b3d4803 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:28.601976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61b9cbc2-a4d6-4290-95dc-e59a8b3d4803 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:28.602491 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61b9cbc2-a4d6-4290-95dc-e59a8b3d4803 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:28.602926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61b9cbc2-a4d6-4290-95dc-e59a8b3d4803 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:28.603611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61b9cbc2-a4d6-4290-95dc-e59a8b3d4803 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:28.604063 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61b9cbc2-a4d6-4290-95dc-e59a8b3d4803 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:28.604487 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-61b9cbc2-a4d6-4290-95dc-e59a8b3d4803 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:28.754685 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-61b9cbc2-a4d6-4290-95dc-e59a8b3d4803 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:28.756629 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7e94ada2-aa8b-4f38-bd13-aa48ccc6adfe tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:28.757442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7e94ada2-aa8b-4f38-bd13-aa48ccc6adfe tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:28.763994 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7e94ada2-aa8b-4f38-bd13-aa48ccc6adfe tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:28.764478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7e94ada2-aa8b-4f38-bd13-aa48ccc6adfe tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:28.764742 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-61b9cbc2-a4d6-4290-95dc-e59a8b3d4803 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.173597 Sep 06 04:45:28.764903 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7e94ada2-aa8b-4f38-bd13-aa48ccc6adfe tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:28.765826 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7e94ada2-aa8b-4f38-bd13-aa48ccc6adfe tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:28.766441 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7e94ada2-aa8b-4f38-bd13-aa48ccc6adfe tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:28.766858 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7e94ada2-aa8b-4f38-bd13-aa48ccc6adfe tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:28.771027 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 511/1000] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:28 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:28.899359 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7e94ada2-aa8b-4f38-bd13-aa48ccc6adfe tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:28.907685 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7e94ada2-aa8b-4f38-bd13-aa48ccc6adfe tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1504 microversion: 2.1 time: 0.154900 Sep 06 04:45:28.908184 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 490/1001] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:28 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1504 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:29.787993 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fa745478-4340-43b4-b7a0-471f1942226e tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:29.788593 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fa745478-4340-43b4-b7a0-471f1942226e tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:29.795361 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa745478-4340-43b4-b7a0-471f1942226e tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:29.795836 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa745478-4340-43b4-b7a0-471f1942226e tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:29.796266 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa745478-4340-43b4-b7a0-471f1942226e tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:29.796948 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa745478-4340-43b4-b7a0-471f1942226e tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:29.797424 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa745478-4340-43b4-b7a0-471f1942226e tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:29.797844 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fa745478-4340-43b4-b7a0-471f1942226e tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:29.931216 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d2f6dfdf-de2b-44a8-abde-8d9ea2b97c20 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:29.931826 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d2f6dfdf-de2b-44a8-abde-8d9ea2b97c20 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:29.938767 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f6dfdf-de2b-44a8-abde-8d9ea2b97c20 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:29.939187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f6dfdf-de2b-44a8-abde-8d9ea2b97c20 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:29.939612 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f6dfdf-de2b-44a8-abde-8d9ea2b97c20 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:29.940335 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f6dfdf-de2b-44a8-abde-8d9ea2b97c20 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:29.940759 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f6dfdf-de2b-44a8-abde-8d9ea2b97c20 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:29.941177 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d2f6dfdf-de2b-44a8-abde-8d9ea2b97c20 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:29.941868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fa745478-4340-43b4-b7a0-471f1942226e tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:29.950879 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fa745478-4340-43b4-b7a0-471f1942226e tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.165885 Sep 06 04:45:29.951384 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 512/1002] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:29 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:30.071261 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d2f6dfdf-de2b-44a8-abde-8d9ea2b97c20 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:30.078967 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d2f6dfdf-de2b-44a8-abde-8d9ea2b97c20 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1504 microversion: 2.1 time: 0.151693 Sep 06 04:45:30.079529 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 491/1003] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:29 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:30.974139 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-40cb3c5f-1ab8-4df9-8852-2649a1dc3b58 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:30.974677 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-40cb3c5f-1ab8-4df9-8852-2649a1dc3b58 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:30.981153 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40cb3c5f-1ab8-4df9-8852-2649a1dc3b58 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:30.981672 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40cb3c5f-1ab8-4df9-8852-2649a1dc3b58 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:30.982112 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40cb3c5f-1ab8-4df9-8852-2649a1dc3b58 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:30.983134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40cb3c5f-1ab8-4df9-8852-2649a1dc3b58 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:30.983592 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40cb3c5f-1ab8-4df9-8852-2649a1dc3b58 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:30.984015 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40cb3c5f-1ab8-4df9-8852-2649a1dc3b58 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:31.102800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d1947eeb-b39a-476c-89f9-84beb5594fd6 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:31.103412 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d1947eeb-b39a-476c-89f9-84beb5594fd6 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:31.111061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1947eeb-b39a-476c-89f9-84beb5594fd6 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:31.111545 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1947eeb-b39a-476c-89f9-84beb5594fd6 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:31.112202 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1947eeb-b39a-476c-89f9-84beb5594fd6 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:31.112938 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1947eeb-b39a-476c-89f9-84beb5594fd6 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:31.113585 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1947eeb-b39a-476c-89f9-84beb5594fd6 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:31.114011 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d1947eeb-b39a-476c-89f9-84beb5594fd6 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:31.127508 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-40cb3c5f-1ab8-4df9-8852-2649a1dc3b58 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:31.132983 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:31.138330 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-40cb3c5f-1ab8-4df9-8852-2649a1dc3b58 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.167915 Sep 06 04:45:31.139489 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 513/1004] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:30 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:31.276922 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d1947eeb-b39a-476c-89f9-84beb5594fd6 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:31.285417 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d1947eeb-b39a-476c-89f9-84beb5594fd6 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1504 microversion: 2.1 time: 0.186414 Sep 06 04:45:31.285979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 492/1005] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:31 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:31.985799 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9213cb16-b535-40c2-9165-1b5fae54a002 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:31.986402 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9213cb16-b535-40c2-9165-1b5fae54a002 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:31.993345 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9213cb16-b535-40c2-9165-1b5fae54a002 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:31.993828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9213cb16-b535-40c2-9165-1b5fae54a002 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:31.994257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9213cb16-b535-40c2-9165-1b5fae54a002 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:31.994930 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9213cb16-b535-40c2-9165-1b5fae54a002 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:31.995380 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9213cb16-b535-40c2-9165-1b5fae54a002 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:31.995797 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9213cb16-b535-40c2-9165-1b5fae54a002 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:32.020042 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-9213cb16-b535-40c2-9165-1b5fae54a002 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lazy-loading 'flavor' on Instance uuid 821737e4-9236-4f80-b1ac-8c4d16c02244 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:45:32.163493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0f4ab24c-63eb-40e1-9757-b90efaef0526 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:32.164096 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0f4ab24c-63eb-40e1-9757-b90efaef0526 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:32.170737 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f4ab24c-63eb-40e1-9757-b90efaef0526 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:32.171208 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f4ab24c-63eb-40e1-9757-b90efaef0526 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:32.171637 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f4ab24c-63eb-40e1-9757-b90efaef0526 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:32.172312 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f4ab24c-63eb-40e1-9757-b90efaef0526 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:32.172754 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f4ab24c-63eb-40e1-9757-b90efaef0526 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:32.173165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f4ab24c-63eb-40e1-9757-b90efaef0526 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:32.314275 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0f4ab24c-63eb-40e1-9757-b90efaef0526 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:32.322396 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0f4ab24c-63eb-40e1-9757-b90efaef0526 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.162717 Sep 06 04:45:32.323040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 493/1006] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:32 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:32.328026 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ee43e830-cbf7-4334-a022-c9bfeec90d2a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:32.328686 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ee43e830-cbf7-4334-a022-c9bfeec90d2a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:32.334413 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee43e830-cbf7-4334-a022-c9bfeec90d2a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:32.334978 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee43e830-cbf7-4334-a022-c9bfeec90d2a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:32.335411 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee43e830-cbf7-4334-a022-c9bfeec90d2a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:32.336091 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee43e830-cbf7-4334-a022-c9bfeec90d2a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:32.336540 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee43e830-cbf7-4334-a022-c9bfeec90d2a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:32.336947 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ee43e830-cbf7-4334-a022-c9bfeec90d2a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:32.479199 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ee43e830-cbf7-4334-a022-c9bfeec90d2a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:32.486035 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9213cb16-b535-40c2-9165-1b5fae54a002 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "POST /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244/action" status: 202 len: 0 microversion: 2.20 time: 0.504134 Sep 06 04:45:32.486638 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 514/1007] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Sep 6 04:45:31 2022] POST /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:45:32.489470 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ee43e830-cbf7-4334-a022-c9bfeec90d2a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1504 microversion: 2.1 time: 0.163072 Sep 06 04:45:32.489470 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 494/1008] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:32 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:32.495017 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-43584ce6-b074-4a2e-9865-d4be1c0c6ddf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:32.495920 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-43584ce6-b074-4a2e-9865-d4be1c0c6ddf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:32.503860 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43584ce6-b074-4a2e-9865-d4be1c0c6ddf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:32.504413 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43584ce6-b074-4a2e-9865-d4be1c0c6ddf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:32.505014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43584ce6-b074-4a2e-9865-d4be1c0c6ddf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:32.505794 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43584ce6-b074-4a2e-9865-d4be1c0c6ddf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:32.506311 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43584ce6-b074-4a2e-9865-d4be1c0c6ddf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:32.506797 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43584ce6-b074-4a2e-9865-d4be1c0c6ddf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:32.649261 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-43584ce6-b074-4a2e-9865-d4be1c0c6ddf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:32.652909 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:32.659320 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-43584ce6-b074-4a2e-9865-d4be1c0c6ddf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:32.664354 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-43584ce6-b074-4a2e-9865-d4be1c0c6ddf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:32.664354 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-43584ce6-b074-4a2e-9865-d4be1c0c6ddf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1725 microversion: 2.20 time: 0.171026 Sep 06 04:45:32.664354 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 495/1009] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:32 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:45:32.930947 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-8677e4cc-d4f5-4091-a8e8-d79f87fefda2 req-336627de-cade-48c1-977e-ca010e4d096f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c82cee62-6001-47e4-bf3a-082527535ff5", "name": "network-vif-deleted", "tag": "4c3904a7-3fe6-4dda-9cbc-88fa5b18e912"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:32.941062 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8677e4cc-d4f5-4091-a8e8-d79f87fefda2 req-336627de-cade-48c1-977e-ca010e4d096f service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:32.941579 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8677e4cc-d4f5-4091-a8e8-d79f87fefda2 req-336627de-cade-48c1-977e-ca010e4d096f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:32.942014 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8677e4cc-d4f5-4091-a8e8-d79f87fefda2 req-336627de-cade-48c1-977e-ca010e4d096f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:32.954267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-8677e4cc-d4f5-4091-a8e8-d79f87fefda2 req-336627de-cade-48c1-977e-ca010e4d096f service nova] Creating event network-vif-deleted:4c3904a7-3fe6-4dda-9cbc-88fa5b18e912 for instance c82cee62-6001-47e4-bf3a-082527535ff5 on hv-cinder-85600 Sep 06 04:45:32.959253 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-8677e4cc-d4f5-4091-a8e8-d79f87fefda2 req-336627de-cade-48c1-977e-ca010e4d096f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032402 Sep 06 04:45:32.959841 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 515/1010] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:45:33.346355 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-43128d42-5dee-47b9-8401-01ae64330680 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:33.346968 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-43128d42-5dee-47b9-8401-01ae64330680 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:33.354033 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43128d42-5dee-47b9-8401-01ae64330680 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:33.354547 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43128d42-5dee-47b9-8401-01ae64330680 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:33.354984 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43128d42-5dee-47b9-8401-01ae64330680 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:33.355671 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43128d42-5dee-47b9-8401-01ae64330680 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:33.356123 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43128d42-5dee-47b9-8401-01ae64330680 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:33.356547 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-43128d42-5dee-47b9-8401-01ae64330680 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:33.504509 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-43128d42-5dee-47b9-8401-01ae64330680 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:33.511522 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-284f144d-575a-42d3-a5c6-758b213ac5be tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:33.512261 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-284f144d-575a-42d3-a5c6-758b213ac5be tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:33.520918 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284f144d-575a-42d3-a5c6-758b213ac5be tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:33.521453 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284f144d-575a-42d3-a5c6-758b213ac5be tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:33.521895 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284f144d-575a-42d3-a5c6-758b213ac5be tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:33.522591 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284f144d-575a-42d3-a5c6-758b213ac5be tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:33.523404 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284f144d-575a-42d3-a5c6-758b213ac5be tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:33.523833 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284f144d-575a-42d3-a5c6-758b213ac5be tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:33.523942 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-43128d42-5dee-47b9-8401-01ae64330680 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.181227 Sep 06 04:45:33.524486 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 496/1011] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:33 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:33.555769 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284f144d-575a-42d3-a5c6-758b213ac5be tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:33.556260 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284f144d-575a-42d3-a5c6-758b213ac5be tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:33.556701 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-284f144d-575a-42d3-a5c6-758b213ac5be tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:33.557144 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-284f144d-575a-42d3-a5c6-758b213ac5be tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lazy-loading 'fault' on Instance uuid c82cee62-6001-47e4-bf3a-082527535ff5 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:45:33.598383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-284f144d-575a-42d3-a5c6-758b213ac5be tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:33.605936 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-284f144d-575a-42d3-a5c6-758b213ac5be tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 200 len: 1304 microversion: 2.1 time: 0.099020 Sep 06 04:45:33.606497 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 516/1012] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:33 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:33.688461 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4feed8c9-3c63-4dff-ba09-b9f92900da80 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:33.689065 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4feed8c9-3c63-4dff-ba09-b9f92900da80 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:33.695052 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4feed8c9-3c63-4dff-ba09-b9f92900da80 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:33.698065 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4feed8c9-3c63-4dff-ba09-b9f92900da80 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:33.698065 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4feed8c9-3c63-4dff-ba09-b9f92900da80 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:33.698065 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4feed8c9-3c63-4dff-ba09-b9f92900da80 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:33.698065 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4feed8c9-3c63-4dff-ba09-b9f92900da80 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:33.698495 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4feed8c9-3c63-4dff-ba09-b9f92900da80 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:33.825821 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4feed8c9-3c63-4dff-ba09-b9f92900da80 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:33.834067 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4feed8c9-3c63-4dff-ba09-b9f92900da80 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:33.835546 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4feed8c9-3c63-4dff-ba09-b9f92900da80 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:33.836726 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4feed8c9-3c63-4dff-ba09-b9f92900da80 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1725 microversion: 2.20 time: 0.152468 Sep 06 04:45:33.837343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 497/1013] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:33 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:34.549168 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1b2ba311-82a5-4978-a5f4-0514d202f708 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:34.549874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1b2ba311-82a5-4978-a5f4-0514d202f708 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:34.556364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b2ba311-82a5-4978-a5f4-0514d202f708 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:34.556853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b2ba311-82a5-4978-a5f4-0514d202f708 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:34.557458 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b2ba311-82a5-4978-a5f4-0514d202f708 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:34.558450 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b2ba311-82a5-4978-a5f4-0514d202f708 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:34.558641 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b2ba311-82a5-4978-a5f4-0514d202f708 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:34.559066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1b2ba311-82a5-4978-a5f4-0514d202f708 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:34.629049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d51a11e7-ec75-4346-85ce-bc2128fff4a8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:34.630526 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d51a11e7-ec75-4346-85ce-bc2128fff4a8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: c82cee62-6001-47e4-bf3a-082527535ff5] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:34.637139 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d51a11e7-ec75-4346-85ce-bc2128fff4a8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:34.637773 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d51a11e7-ec75-4346-85ce-bc2128fff4a8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:34.638473 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d51a11e7-ec75-4346-85ce-bc2128fff4a8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:34.639177 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d51a11e7-ec75-4346-85ce-bc2128fff4a8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:34.639616 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d51a11e7-ec75-4346-85ce-bc2128fff4a8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:34.640531 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d51a11e7-ec75-4346-85ce-bc2128fff4a8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:34.655723 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-d51a11e7-ec75-4346-85ce-bc2128fff4a8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] HTTP exception thrown: Instance c82cee62-6001-47e4-bf3a-082527535ff5 could not be found. Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d51a11e7-ec75-4346-85ce-bc2128fff4a8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Request method failure captured: Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 HTTP/1.1 Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFtBRNL2Aaaa-XiEE-UZNy8PE7lOlyjfI4Q5xb3xvGOjYjaB0NAX-YceDWraFgHuMgTf-uPwGlnGt1nNHCYxpSGvFWJsiRkEq14krg66F69nctkJpFVpDG7_nYu2D9ae-TxRRfLqAsaA1O4KQLcO7TW5dSC_YxKP8NC6Kni7AT3BeCtM Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 5f758de124e64932af3cc80ed348f51c Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesActionsTest-1765501802 Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:45:34.657401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:45:34.659118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5f758de124e64932af3cc80ed348f51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5f758de124e64932af3cc80ed348f51c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5f758de124e64932af3cc80ed348f51c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5f758de124e64932af3cc80ed348f51c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:45:34.659118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesActionsTest-1765501802 Sep 06 04:45:34.659118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 5f758de124e64932af3cc80ed348f51c Sep 06 04:45:34.659118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesActionsTest-1765501802 Sep 06 04:45:34.659118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesActionsTest-1765501802-project Sep 06 04:45:34.659118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:45:34.659118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:45:34.659118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 84150d0100be498b84f4b9a54525a986 Sep 06 04:45:34.659118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesActionsTest-1765501802-project Sep 06 04:45:34.659118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:45:34.659118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance c82cee62-6001-47e4-bf3a-082527535ff5 could not be found. Sep 06 04:45:34.659118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': 'c82cee62-6001-47e4-bf3a-082527535ff5'} Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c82cee62-6001-47e4-bf3a-082527535ff5 could not be found. Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:45:34.660584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c82cee62-6001-47e4-bf3a-082527535ff5 could not be found. Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c82cee62-6001-47e4-bf3a-082527535ff5 could not be found. Sep 06 04:45:34.662032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:45:34.663382 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d51a11e7-ec75-4346-85ce-bc2128fff4a8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Returning 404 to user: Instance c82cee62-6001-47e4-bf3a-082527535ff5 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:45:34.663382 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d51a11e7-ec75-4346-85ce-bc2128fff4a8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5" status: 404 len: 111 microversion: 2.1 time: 0.033658 Sep 06 04:45:34.663382 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 498/1014] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:34 2022] GET /compute/v2.1/servers/c82cee62-6001-47e4-bf3a-082527535ff5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:45:34.717059 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1845754150", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "networks": [{"uuid": "3d3d4564-d0e1-4ed7-9376-767df6f5c221"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:34.718058 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1b2ba311-82a5-4978-a5f4-0514d202f708 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:34.726438 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1b2ba311-82a5-4978-a5f4-0514d202f708 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.182543 Sep 06 04:45:34.726989 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 517/1015] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:34 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:34.770357 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] validate_networks() for [('3d3d4564-d0e1-4ed7-9376-767df6f5c221', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:45:34.862690 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d75193f8-5b4c-4133-ae70-7e6efa9839fc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:34.863407 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d75193f8-5b4c-4133-ae70-7e6efa9839fc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:34.869475 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d75193f8-5b4c-4133-ae70-7e6efa9839fc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:34.869943 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d75193f8-5b4c-4133-ae70-7e6efa9839fc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:34.870381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d75193f8-5b4c-4133-ae70-7e6efa9839fc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:34.871068 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d75193f8-5b4c-4133-ae70-7e6efa9839fc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:34.871523 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d75193f8-5b4c-4133-ae70-7e6efa9839fc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:34.871945 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d75193f8-5b4c-4133-ae70-7e6efa9839fc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:35.006710 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d75193f8-5b4c-4133-ae70-7e6efa9839fc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:35.015482 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d75193f8-5b4c-4133-ae70-7e6efa9839fc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:35.016902 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d75193f8-5b4c-4133-ae70-7e6efa9839fc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:35.018206 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d75193f8-5b4c-4133-ae70-7e6efa9839fc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1725 microversion: 2.20 time: 0.159467 Sep 06 04:45:35.018975 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 518/1016] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:34 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:35.127709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:45:35.128170 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:45:35.128649 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:45:35.129055 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:45:35.129498 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:45:35.138298 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:35.138864 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:35.139300 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:35.140027 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:35.140483 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:35.140905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:35.158110 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Getting quotas for project 5f758de124e64932af3cc80ed348f51c. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:45:35.162019 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Getting quotas for user 84150d0100be498b84f4b9a54525a986 and project 5f758de124e64932af3cc80ed348f51c. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:45:35.173097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:45:35.177275 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:45:35.288046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-67cb057e-c261-47ff-8b05-4058e4f2f389 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575673 Sep 06 04:45:35.288790 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 499/1017] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:45:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 06 04:45:35.300269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d79658a3-123e-4bac-9c8d-462ecea72f99 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:35.300986 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d79658a3-123e-4bac-9c8d-462ecea72f99 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:35.354672 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d79658a3-123e-4bac-9c8d-462ecea72f99 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:35.362184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d79658a3-123e-4bac-9c8d-462ecea72f99 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1214 microversion: 2.1 time: 0.064880 Sep 06 04:45:35.362184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 519/1018] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:35 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:35.751745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ec6aa44e-135d-42e4-9e86-f98f47b5aa20 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:35.752277 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ec6aa44e-135d-42e4-9e86-f98f47b5aa20 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:35.759191 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec6aa44e-135d-42e4-9e86-f98f47b5aa20 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:35.759669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec6aa44e-135d-42e4-9e86-f98f47b5aa20 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:35.760099 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec6aa44e-135d-42e4-9e86-f98f47b5aa20 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:35.760783 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec6aa44e-135d-42e4-9e86-f98f47b5aa20 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:35.761229 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec6aa44e-135d-42e4-9e86-f98f47b5aa20 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:35.761681 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ec6aa44e-135d-42e4-9e86-f98f47b5aa20 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:35.912381 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ec6aa44e-135d-42e4-9e86-f98f47b5aa20 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:35.921978 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ec6aa44e-135d-42e4-9e86-f98f47b5aa20 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.174878 Sep 06 04:45:35.923165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 500/1019] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:35 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:36.043518 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-086cae4a-e641-4d5c-8d50-36352add489f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:36.044126 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-086cae4a-e641-4d5c-8d50-36352add489f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:36.052039 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-086cae4a-e641-4d5c-8d50-36352add489f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:36.052530 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-086cae4a-e641-4d5c-8d50-36352add489f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:36.052976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-086cae4a-e641-4d5c-8d50-36352add489f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:36.053694 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-086cae4a-e641-4d5c-8d50-36352add489f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:36.054153 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-086cae4a-e641-4d5c-8d50-36352add489f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:36.054582 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-086cae4a-e641-4d5c-8d50-36352add489f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:36.257412 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-086cae4a-e641-4d5c-8d50-36352add489f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:36.266681 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-086cae4a-e641-4d5c-8d50-36352add489f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:36.268183 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-086cae4a-e641-4d5c-8d50-36352add489f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:36.269392 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-086cae4a-e641-4d5c-8d50-36352add489f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1725 microversion: 2.20 time: 0.229846 Sep 06 04:45:36.274562 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 520/1020] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:36 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:45:36.384581 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2a0f85a2-cf68-4fc7-87b4-2dabbe4e282b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:36.385195 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2a0f85a2-cf68-4fc7-87b4-2dabbe4e282b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:36.392120 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a0f85a2-cf68-4fc7-87b4-2dabbe4e282b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:36.392602 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a0f85a2-cf68-4fc7-87b4-2dabbe4e282b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:36.393039 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a0f85a2-cf68-4fc7-87b4-2dabbe4e282b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:36.393760 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a0f85a2-cf68-4fc7-87b4-2dabbe4e282b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:36.394217 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a0f85a2-cf68-4fc7-87b4-2dabbe4e282b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:36.394638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a0f85a2-cf68-4fc7-87b4-2dabbe4e282b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:36.459003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2a0f85a2-cf68-4fc7-87b4-2dabbe4e282b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:36.467762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2a0f85a2-cf68-4fc7-87b4-2dabbe4e282b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1218 microversion: 2.1 time: 0.087037 Sep 06 04:45:36.468329 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 501/1021] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:36 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:36.946175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d8e81348-3e00-493f-8639-2e8fb5e8c16a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:36.946795 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d8e81348-3e00-493f-8639-2e8fb5e8c16a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:36.953345 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8e81348-3e00-493f-8639-2e8fb5e8c16a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:36.953824 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8e81348-3e00-493f-8639-2e8fb5e8c16a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:36.954255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8e81348-3e00-493f-8639-2e8fb5e8c16a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:36.954977 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8e81348-3e00-493f-8639-2e8fb5e8c16a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:36.955426 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8e81348-3e00-493f-8639-2e8fb5e8c16a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:36.955844 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8e81348-3e00-493f-8639-2e8fb5e8c16a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:37.109383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d8e81348-3e00-493f-8639-2e8fb5e8c16a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:37.117616 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d8e81348-3e00-493f-8639-2e8fb5e8c16a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.175220 Sep 06 04:45:37.118162 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 521/1022] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:36 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:37.294356 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1b9a82e5-ac3f-44b4-a5a9-67d44ef75259 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:37.294871 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1b9a82e5-ac3f-44b4-a5a9-67d44ef75259 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:37.301447 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b9a82e5-ac3f-44b4-a5a9-67d44ef75259 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:37.301929 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b9a82e5-ac3f-44b4-a5a9-67d44ef75259 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:37.302359 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b9a82e5-ac3f-44b4-a5a9-67d44ef75259 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:37.303034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b9a82e5-ac3f-44b4-a5a9-67d44ef75259 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:37.303481 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b9a82e5-ac3f-44b4-a5a9-67d44ef75259 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:37.303896 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1b9a82e5-ac3f-44b4-a5a9-67d44ef75259 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:37.439915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1b9a82e5-ac3f-44b4-a5a9-67d44ef75259 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:37.447980 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1b9a82e5-ac3f-44b4-a5a9-67d44ef75259 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:37.449446 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1b9a82e5-ac3f-44b4-a5a9-67d44ef75259 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:37.450601 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1b9a82e5-ac3f-44b4-a5a9-67d44ef75259 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1725 microversion: 2.20 time: 0.160223 Sep 06 04:45:37.451158 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 502/1023] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:37 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:37.491220 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-27eacb48-e523-4527-83cb-9ab657985db3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:37.491820 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-27eacb48-e523-4527-83cb-9ab657985db3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:37.497675 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27eacb48-e523-4527-83cb-9ab657985db3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:37.498159 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27eacb48-e523-4527-83cb-9ab657985db3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:37.499138 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27eacb48-e523-4527-83cb-9ab657985db3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:37.499270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27eacb48-e523-4527-83cb-9ab657985db3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:37.499700 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27eacb48-e523-4527-83cb-9ab657985db3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:37.500114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-27eacb48-e523-4527-83cb-9ab657985db3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:37.567210 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-27eacb48-e523-4527-83cb-9ab657985db3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:37.574920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-27eacb48-e523-4527-83cb-9ab657985db3 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1266 microversion: 2.1 time: 0.087761 Sep 06 04:45:37.575473 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 522/1024] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:37 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:37.894062 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-830019011", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-153806682", "security_groups": [{"name": "tempest-secgroup-smoke-1357749998"}], "block_device_mapping_v2": [{"uuid": "44fd9b83-50fb-46f2-bbc9-2bfbbe20415c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "713bea32-eeee-4105-a352-3326771fb659"}]}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:38.012793 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.network.neutron [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] validate_networks() for [('713bea32-eeee-4105-a352-3326771fb659', None, None, None, None, None)] {{(pid=127617) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:45:38.140367 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6e31a9d5-ffeb-4300-b0cd-475078c6531d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:38.141772 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6e31a9d5-ffeb-4300-b0cd-475078c6531d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:38.148184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e31a9d5-ffeb-4300-b0cd-475078c6531d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:38.148868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e31a9d5-ffeb-4300-b0cd-475078c6531d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:38.149334 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e31a9d5-ffeb-4300-b0cd-475078c6531d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:38.150038 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e31a9d5-ffeb-4300-b0cd-475078c6531d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:38.150505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e31a9d5-ffeb-4300-b0cd-475078c6531d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:38.150934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6e31a9d5-ffeb-4300-b0cd-475078c6531d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:38.337379 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6e31a9d5-ffeb-4300-b0cd-475078c6531d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:38.346572 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6e31a9d5-ffeb-4300-b0cd-475078c6531d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.210329 Sep 06 04:45:38.348060 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 523/1025] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:38 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:38.407580 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Flavor limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:45:38.408034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Image limits 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:45:38.408813 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Flavor pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:45:38.408813 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Image pref 0:0:0 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:45:38.409463 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.virt.hardware [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127617) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:45:38.418337 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:38.418827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:38.419264 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:38.419994 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:38.421131 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:38.421815 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:38.439442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Getting quotas for project 375efd2890fc4b71af13439813f00ab0. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:45:38.443179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Getting quotas for user 4b6c761af9c5457ea1e481ce400aded8 and project 375efd2890fc4b71af13439813f00ab0. Resources: {'cores', 'instances', 'ram'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:45:38.480547 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e2ddc3bb-89b8-40e3-8382-d8545f3c7429 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:38.481151 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e2ddc3bb-89b8-40e3-8382-d8545f3c7429 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:38.488129 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2ddc3bb-89b8-40e3-8382-d8545f3c7429 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:38.488775 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2ddc3bb-89b8-40e3-8382-d8545f3c7429 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:38.489294 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2ddc3bb-89b8-40e3-8382-d8545f3c7429 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:38.489913 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2ddc3bb-89b8-40e3-8382-d8545f3c7429 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:38.490364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2ddc3bb-89b8-40e3-8382-d8545f3c7429 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:38.490774 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2ddc3bb-89b8-40e3-8382-d8545f3c7429 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:38.505348 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Going to run 1 instances... {{(pid=127617) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:45:38.509928 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='44fd9b83-50fb-46f2-bbc9-2bfbbe20415c',volume_size=None,volume_type=None)] {{(pid=127617) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:45:38.630425 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e2ddc3bb-89b8-40e3-8382-d8545f3c7429 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:38.638657 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e2ddc3bb-89b8-40e3-8382-d8545f3c7429 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:38.640165 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e2ddc3bb-89b8-40e3-8382-d8545f3c7429 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:38.641316 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e2ddc3bb-89b8-40e3-8382-d8545f3c7429 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1725 microversion: 2.20 time: 0.167122 Sep 06 04:45:38.641878 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 524/1026] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:38 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:38.647174 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b0899e63-e133-47f7-b1c0-e82796deb54b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:38.651821 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b0899e63-e133-47f7-b1c0-e82796deb54b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:38.654701 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0899e63-e133-47f7-b1c0-e82796deb54b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:38.655251 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0899e63-e133-47f7-b1c0-e82796deb54b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:38.655682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0899e63-e133-47f7-b1c0-e82796deb54b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:38.656367 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0899e63-e133-47f7-b1c0-e82796deb54b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:38.656812 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0899e63-e133-47f7-b1c0-e82796deb54b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:38.657225 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0899e63-e133-47f7-b1c0-e82796deb54b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:38.864058 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b0899e63-e133-47f7-b1c0-e82796deb54b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:38.872038 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b0899e63-e133-47f7-b1c0-e82796deb54b tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.229172 Sep 06 04:45:38.872604 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 525/1027] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:38 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:38.890943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-47af6f87-c3ec-4e85-a2e9-585b244c3a9b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.001315 Sep 06 04:45:38.891638 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 503/1028] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:45:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:45:38.902720 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f98699c3-ae4a-4405-b5c2-868924d3c9df tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:38.903492 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f98699c3-ae4a-4405-b5c2-868924d3c9df tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:38.972740 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f98699c3-ae4a-4405-b5c2-868924d3c9df tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:38.979878 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f98699c3-ae4a-4405-b5c2-868924d3c9df tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1093 microversion: 2.1 time: 0.080863 Sep 06 04:45:38.980497 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 526/1029] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:38 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1093 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:39.371711 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-80b14763-8762-4bd6-8212-b1864ffa8b98 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:39.372271 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-80b14763-8762-4bd6-8212-b1864ffa8b98 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:39.379002 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80b14763-8762-4bd6-8212-b1864ffa8b98 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:39.379484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80b14763-8762-4bd6-8212-b1864ffa8b98 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:39.384629 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80b14763-8762-4bd6-8212-b1864ffa8b98 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:39.386713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80b14763-8762-4bd6-8212-b1864ffa8b98 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:39.386713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80b14763-8762-4bd6-8212-b1864ffa8b98 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:39.386713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-80b14763-8762-4bd6-8212-b1864ffa8b98 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:39.536781 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-80b14763-8762-4bd6-8212-b1864ffa8b98 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:39.546297 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-80b14763-8762-4bd6-8212-b1864ffa8b98 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.178164 Sep 06 04:45:39.547302 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 504/1030] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:39 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:39.559895 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-b7d8b2c0-8ecb-4822-908e-214649572cd7 req-81e11235-6e6b-485f-9ec4-7d5369b5ec4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acc63ec5-2ef0-416d-957a-76e83eb7a5c0", "tag": "9d2e20a6-91b7-4e08-b9cc-3a354079b32c"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:39.577488 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b7d8b2c0-8ecb-4822-908e-214649572cd7 req-81e11235-6e6b-485f-9ec4-7d5369b5ec4b service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:39.578101 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b7d8b2c0-8ecb-4822-908e-214649572cd7 req-81e11235-6e6b-485f-9ec4-7d5369b5ec4b service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:39.578597 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b7d8b2c0-8ecb-4822-908e-214649572cd7 req-81e11235-6e6b-485f-9ec4-7d5369b5ec4b service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:39.589047 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-b7d8b2c0-8ecb-4822-908e-214649572cd7 req-81e11235-6e6b-485f-9ec4-7d5369b5ec4b service nova] Creating event network-changed:9d2e20a6-91b7-4e08-b9cc-3a354079b32c for instance acc63ec5-2ef0-416d-957a-76e83eb7a5c0 on hv-cinder-85600 Sep 06 04:45:39.595470 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-b7d8b2c0-8ecb-4822-908e-214649572cd7 req-81e11235-6e6b-485f-9ec4-7d5369b5ec4b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039200 Sep 06 04:45:39.596662 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 527/1031] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:45:39.667235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dc193423-3d1e-4f94-ac6d-2da8de2f8aa1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:39.667935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dc193423-3d1e-4f94-ac6d-2da8de2f8aa1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:39.674915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc193423-3d1e-4f94-ac6d-2da8de2f8aa1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:39.676823 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc193423-3d1e-4f94-ac6d-2da8de2f8aa1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:39.676823 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc193423-3d1e-4f94-ac6d-2da8de2f8aa1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:39.676823 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc193423-3d1e-4f94-ac6d-2da8de2f8aa1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:39.677097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc193423-3d1e-4f94-ac6d-2da8de2f8aa1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:39.677487 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc193423-3d1e-4f94-ac6d-2da8de2f8aa1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:39.807286 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dc193423-3d1e-4f94-ac6d-2da8de2f8aa1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:39.815591 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dc193423-3d1e-4f94-ac6d-2da8de2f8aa1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:39.817021 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dc193423-3d1e-4f94-ac6d-2da8de2f8aa1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:39.818214 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dc193423-3d1e-4f94-ac6d-2da8de2f8aa1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1725 microversion: 2.20 time: 0.155066 Sep 06 04:45:39.818779 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 505/1032] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:39 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:45:39.896223 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-74019efd-732e-4abf-b6ed-6c967beafbe0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:39.897097 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-74019efd-732e-4abf-b6ed-6c967beafbe0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:39.903406 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74019efd-732e-4abf-b6ed-6c967beafbe0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:39.905625 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74019efd-732e-4abf-b6ed-6c967beafbe0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:39.905625 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74019efd-732e-4abf-b6ed-6c967beafbe0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:39.906172 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74019efd-732e-4abf-b6ed-6c967beafbe0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:39.906639 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74019efd-732e-4abf-b6ed-6c967beafbe0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:39.907059 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-74019efd-732e-4abf-b6ed-6c967beafbe0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:40.002757 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ce17ebf3-edb1-41db-bda3-de87d505bc60 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:40.003421 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ce17ebf3-edb1-41db-bda3-de87d505bc60 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:40.010032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce17ebf3-edb1-41db-bda3-de87d505bc60 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:40.010709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce17ebf3-edb1-41db-bda3-de87d505bc60 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:40.011153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce17ebf3-edb1-41db-bda3-de87d505bc60 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:40.011850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce17ebf3-edb1-41db-bda3-de87d505bc60 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:40.012414 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce17ebf3-edb1-41db-bda3-de87d505bc60 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:40.013160 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce17ebf3-edb1-41db-bda3-de87d505bc60 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:40.082320 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ce17ebf3-edb1-41db-bda3-de87d505bc60 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:40.090825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ce17ebf3-edb1-41db-bda3-de87d505bc60 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1143 microversion: 2.1 time: 0.091880 Sep 06 04:45:40.091364 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 506/1033] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:39 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1143 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:40.140853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-74019efd-732e-4abf-b6ed-6c967beafbe0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:40.153045 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-74019efd-732e-4abf-b6ed-6c967beafbe0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.261059 Sep 06 04:45:40.153765 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 528/1034] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:39 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:40.571063 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4db22d0c-c323-4a47-ab53-253029e3def7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:40.571723 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4db22d0c-c323-4a47-ab53-253029e3def7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:40.578301 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4db22d0c-c323-4a47-ab53-253029e3def7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:40.578773 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4db22d0c-c323-4a47-ab53-253029e3def7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:40.579198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4db22d0c-c323-4a47-ab53-253029e3def7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:40.579875 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4db22d0c-c323-4a47-ab53-253029e3def7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:40.580351 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4db22d0c-c323-4a47-ab53-253029e3def7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:40.580771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4db22d0c-c323-4a47-ab53-253029e3def7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:40.726176 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4db22d0c-c323-4a47-ab53-253029e3def7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:40.734506 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4db22d0c-c323-4a47-ab53-253029e3def7 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.167522 Sep 06 04:45:40.735071 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 507/1035] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:40 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:40.844424 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b8783aa1-12ff-4ee5-af2d-ca0d6cc95023 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:40.844958 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b8783aa1-12ff-4ee5-af2d-ca0d6cc95023 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:40.851260 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8783aa1-12ff-4ee5-af2d-ca0d6cc95023 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:40.851736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8783aa1-12ff-4ee5-af2d-ca0d6cc95023 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:40.852168 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8783aa1-12ff-4ee5-af2d-ca0d6cc95023 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:40.852843 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8783aa1-12ff-4ee5-af2d-ca0d6cc95023 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:40.853293 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8783aa1-12ff-4ee5-af2d-ca0d6cc95023 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:40.853732 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b8783aa1-12ff-4ee5-af2d-ca0d6cc95023 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:40.982985 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b8783aa1-12ff-4ee5-af2d-ca0d6cc95023 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:40.991134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b8783aa1-12ff-4ee5-af2d-ca0d6cc95023 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:40.992563 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b8783aa1-12ff-4ee5-af2d-ca0d6cc95023 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:40.993754 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b8783aa1-12ff-4ee5-af2d-ca0d6cc95023 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1725 microversion: 2.20 time: 0.153867 Sep 06 04:45:40.994314 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 529/1036] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:40 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:41.113733 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0de0d990-6b0b-4ca6-aec9-bd8636783b1d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:41.114271 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0de0d990-6b0b-4ca6-aec9-bd8636783b1d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:41.120234 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0de0d990-6b0b-4ca6-aec9-bd8636783b1d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:41.120713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0de0d990-6b0b-4ca6-aec9-bd8636783b1d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:41.121150 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0de0d990-6b0b-4ca6-aec9-bd8636783b1d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:41.121867 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0de0d990-6b0b-4ca6-aec9-bd8636783b1d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:41.122325 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0de0d990-6b0b-4ca6-aec9-bd8636783b1d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:41.122748 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0de0d990-6b0b-4ca6-aec9-bd8636783b1d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:41.176564 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-2fe0fe07-7abd-4453-9f14-89bf9bcfe341 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:41.177168 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-2fe0fe07-7abd-4453-9f14-89bf9bcfe341 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:41.182691 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0de0d990-6b0b-4ca6-aec9-bd8636783b1d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:41.183330 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2fe0fe07-7abd-4453-9f14-89bf9bcfe341 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:41.183820 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2fe0fe07-7abd-4453-9f14-89bf9bcfe341 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:41.184257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2fe0fe07-7abd-4453-9f14-89bf9bcfe341 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:41.184949 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2fe0fe07-7abd-4453-9f14-89bf9bcfe341 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:41.185436 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2fe0fe07-7abd-4453-9f14-89bf9bcfe341 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:41.186387 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-2fe0fe07-7abd-4453-9f14-89bf9bcfe341 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:41.191195 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0de0d990-6b0b-4ca6-aec9-bd8636783b1d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1191 microversion: 2.1 time: 0.081338 Sep 06 04:45:41.191762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 508/1037] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:41 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:41.314313 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-2fe0fe07-7abd-4453-9f14-89bf9bcfe341 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:41.321984 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-2fe0fe07-7abd-4453-9f14-89bf9bcfe341 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.149208 Sep 06 04:45:41.322545 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 530/1038] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:41 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:41.758035 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d8f1465f-3efc-4f24-bdd6-ca11b7247870 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:41.758550 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d8f1465f-3efc-4f24-bdd6-ca11b7247870 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:41.765043 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8f1465f-3efc-4f24-bdd6-ca11b7247870 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:41.765547 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8f1465f-3efc-4f24-bdd6-ca11b7247870 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:41.765979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8f1465f-3efc-4f24-bdd6-ca11b7247870 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:41.766653 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8f1465f-3efc-4f24-bdd6-ca11b7247870 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:41.767098 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8f1465f-3efc-4f24-bdd6-ca11b7247870 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:41.767610 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8f1465f-3efc-4f24-bdd6-ca11b7247870 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:41.904565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d8f1465f-3efc-4f24-bdd6-ca11b7247870 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:41.913158 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d8f1465f-3efc-4f24-bdd6-ca11b7247870 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.159063 Sep 06 04:45:41.913747 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 509/1039] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:41 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:42.018512 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bff71b08-3b12-4c91-b633-1019547dd583 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:42.019034 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bff71b08-3b12-4c91-b633-1019547dd583 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:42.025430 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bff71b08-3b12-4c91-b633-1019547dd583 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:42.025914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bff71b08-3b12-4c91-b633-1019547dd583 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:42.026352 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bff71b08-3b12-4c91-b633-1019547dd583 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:42.027037 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bff71b08-3b12-4c91-b633-1019547dd583 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:42.027498 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bff71b08-3b12-4c91-b633-1019547dd583 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:42.027921 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bff71b08-3b12-4c91-b633-1019547dd583 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:42.043398 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:42.162680 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bff71b08-3b12-4c91-b633-1019547dd583 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:42.170699 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bff71b08-3b12-4c91-b633-1019547dd583 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:42.172136 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bff71b08-3b12-4c91-b633-1019547dd583 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:42.173300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bff71b08-3b12-4c91-b633-1019547dd583 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1725 microversion: 2.20 time: 0.159583 Sep 06 04:45:42.173877 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 531/1040] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:42 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:42.214550 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9b484020-fca9-44f3-b674-730337837be4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:42.215188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9b484020-fca9-44f3-b674-730337837be4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:42.221186 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9b484020-fca9-44f3-b674-730337837be4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:42.221689 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9b484020-fca9-44f3-b674-730337837be4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:42.222125 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9b484020-fca9-44f3-b674-730337837be4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:42.222838 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9b484020-fca9-44f3-b674-730337837be4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:42.223291 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9b484020-fca9-44f3-b674-730337837be4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:42.223712 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9b484020-fca9-44f3-b674-730337837be4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:42.287366 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9b484020-fca9-44f3-b674-730337837be4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:42.294972 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9b484020-fca9-44f3-b674-730337837be4 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1191 microversion: 2.1 time: 0.084346 Sep 06 04:45:42.295687 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 510/1041] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:42 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:42.347567 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4c650ff3-99a1-4c02-9e0d-382e1f433707 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:42.348202 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4c650ff3-99a1-4c02-9e0d-382e1f433707 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:42.354159 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c650ff3-99a1-4c02-9e0d-382e1f433707 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:42.354635 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c650ff3-99a1-4c02-9e0d-382e1f433707 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:42.355064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c650ff3-99a1-4c02-9e0d-382e1f433707 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:42.355734 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c650ff3-99a1-4c02-9e0d-382e1f433707 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:42.356189 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c650ff3-99a1-4c02-9e0d-382e1f433707 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:42.356605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4c650ff3-99a1-4c02-9e0d-382e1f433707 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:42.484148 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4c650ff3-99a1-4c02-9e0d-382e1f433707 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:42.491656 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4c650ff3-99a1-4c02-9e0d-382e1f433707 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.147907 Sep 06 04:45:42.492208 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 532/1042] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:42 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:42.936679 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e95756d4-9ee1-4c82-84b7-a99d6a066e11 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:42.937280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e95756d4-9ee1-4c82-84b7-a99d6a066e11 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:42.943825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e95756d4-9ee1-4c82-84b7-a99d6a066e11 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:42.944298 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e95756d4-9ee1-4c82-84b7-a99d6a066e11 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:42.944723 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e95756d4-9ee1-4c82-84b7-a99d6a066e11 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:42.945427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e95756d4-9ee1-4c82-84b7-a99d6a066e11 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:42.945871 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e95756d4-9ee1-4c82-84b7-a99d6a066e11 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:42.946286 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e95756d4-9ee1-4c82-84b7-a99d6a066e11 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:43.093628 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e95756d4-9ee1-4c82-84b7-a99d6a066e11 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:43.101821 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e95756d4-9ee1-4c82-84b7-a99d6a066e11 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.169468 Sep 06 04:45:43.102389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 511/1043] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:42 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:43.198165 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-961969d9-1374-45e1-8b14-41e0dc55aac8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:43.198165 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-961969d9-1374-45e1-8b14-41e0dc55aac8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:43.205773 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-961969d9-1374-45e1-8b14-41e0dc55aac8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:43.206250 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-961969d9-1374-45e1-8b14-41e0dc55aac8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:43.206686 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-961969d9-1374-45e1-8b14-41e0dc55aac8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:43.207376 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-961969d9-1374-45e1-8b14-41e0dc55aac8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:43.207830 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-961969d9-1374-45e1-8b14-41e0dc55aac8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:43.208395 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-961969d9-1374-45e1-8b14-41e0dc55aac8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:43.318563 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d4702c32-6552-4d44-beec-21162e9ba690 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:43.319472 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d4702c32-6552-4d44-beec-21162e9ba690 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:43.325526 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4702c32-6552-4d44-beec-21162e9ba690 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:43.326006 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4702c32-6552-4d44-beec-21162e9ba690 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:43.326527 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4702c32-6552-4d44-beec-21162e9ba690 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:43.328257 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4702c32-6552-4d44-beec-21162e9ba690 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:43.328785 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4702c32-6552-4d44-beec-21162e9ba690 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:43.329325 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d4702c32-6552-4d44-beec-21162e9ba690 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:43.347278 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-961969d9-1374-45e1-8b14-41e0dc55aac8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:43.355613 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-961969d9-1374-45e1-8b14-41e0dc55aac8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:43.357034 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-961969d9-1374-45e1-8b14-41e0dc55aac8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:43.358671 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-961969d9-1374-45e1-8b14-41e0dc55aac8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1725 microversion: 2.20 time: 0.164890 Sep 06 04:45:43.359236 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 533/1044] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:43 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:43.394805 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d4702c32-6552-4d44-beec-21162e9ba690 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:43.402558 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d4702c32-6552-4d44-beec-21162e9ba690 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1191 microversion: 2.1 time: 0.088016 Sep 06 04:45:43.403123 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 512/1045] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:43 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1191 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:43.515069 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-849be58d-7e36-4dfb-a105-422d1642d0aa tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:43.515787 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-849be58d-7e36-4dfb-a105-422d1642d0aa tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:43.521693 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-849be58d-7e36-4dfb-a105-422d1642d0aa tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:43.522174 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-849be58d-7e36-4dfb-a105-422d1642d0aa tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:43.522608 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-849be58d-7e36-4dfb-a105-422d1642d0aa tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:43.523295 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-849be58d-7e36-4dfb-a105-422d1642d0aa tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:43.523748 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-849be58d-7e36-4dfb-a105-422d1642d0aa tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:43.524169 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-849be58d-7e36-4dfb-a105-422d1642d0aa tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:43.652976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-849be58d-7e36-4dfb-a105-422d1642d0aa tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:43.661519 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-849be58d-7e36-4dfb-a105-422d1642d0aa tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.151128 Sep 06 04:45:43.662083 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 534/1046] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:43 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:44.125761 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5833e484-9350-4794-b3df-66e8ddd789c3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:44.126368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5833e484-9350-4794-b3df-66e8ddd789c3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:44.132881 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5833e484-9350-4794-b3df-66e8ddd789c3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:44.133397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5833e484-9350-4794-b3df-66e8ddd789c3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:44.133833 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5833e484-9350-4794-b3df-66e8ddd789c3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:44.134550 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5833e484-9350-4794-b3df-66e8ddd789c3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:44.134995 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5833e484-9350-4794-b3df-66e8ddd789c3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:44.135411 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5833e484-9350-4794-b3df-66e8ddd789c3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:44.393173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f20d4cf5-8336-433e-b44f-9e2a50d171f2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:44.394489 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f20d4cf5-8336-433e-b44f-9e2a50d171f2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:44.401078 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f20d4cf5-8336-433e-b44f-9e2a50d171f2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:44.401669 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f20d4cf5-8336-433e-b44f-9e2a50d171f2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:44.402173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f20d4cf5-8336-433e-b44f-9e2a50d171f2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:44.402936 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f20d4cf5-8336-433e-b44f-9e2a50d171f2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:44.403458 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f20d4cf5-8336-433e-b44f-9e2a50d171f2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:44.403947 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f20d4cf5-8336-433e-b44f-9e2a50d171f2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:44.536973 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5833e484-9350-4794-b3df-66e8ddd789c3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:44.541945 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f20d4cf5-8336-433e-b44f-9e2a50d171f2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:44.545585 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5833e484-9350-4794-b3df-66e8ddd789c3 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1756 microversion: 2.1 time: 0.424232 Sep 06 04:45:44.546381 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 513/1047] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:44 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1756 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:44.550897 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f20d4cf5-8336-433e-b44f-9e2a50d171f2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:44.552367 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f20d4cf5-8336-433e-b44f-9e2a50d171f2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:44.553549 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f20d4cf5-8336-433e-b44f-9e2a50d171f2 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1725 microversion: 2.20 time: 0.172479 Sep 06 04:45:44.554086 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 535/1048] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:44 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:45:44.563874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-93db57a6-d23a-43e8-8b21-db25e7b10282 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:44.564484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-93db57a6-d23a-43e8-8b21-db25e7b10282 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:44.570442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93db57a6-d23a-43e8-8b21-db25e7b10282 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:44.570927 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93db57a6-d23a-43e8-8b21-db25e7b10282 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:44.571367 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93db57a6-d23a-43e8-8b21-db25e7b10282 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:44.572052 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93db57a6-d23a-43e8-8b21-db25e7b10282 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:44.572503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93db57a6-d23a-43e8-8b21-db25e7b10282 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:44.572925 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93db57a6-d23a-43e8-8b21-db25e7b10282 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:44.592822 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:44.634126 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-93db57a6-d23a-43e8-8b21-db25e7b10282 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:44.649070 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-93db57a6-d23a-43e8-8b21-db25e7b10282 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1191 microversion: 2.1 time: 0.082748 Sep 06 04:45:44.649070 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 514/1049] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:44 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1191 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:44.684671 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d4674ff9-82fb-49b1-abe9-a4eeba55f013 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:44.685282 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d4674ff9-82fb-49b1-abe9-a4eeba55f013 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:44.691623 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4674ff9-82fb-49b1-abe9-a4eeba55f013 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:44.692114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4674ff9-82fb-49b1-abe9-a4eeba55f013 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:44.692553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4674ff9-82fb-49b1-abe9-a4eeba55f013 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:44.693250 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4674ff9-82fb-49b1-abe9-a4eeba55f013 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:44.693734 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4674ff9-82fb-49b1-abe9-a4eeba55f013 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:44.694459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4674ff9-82fb-49b1-abe9-a4eeba55f013 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:44.829959 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d4674ff9-82fb-49b1-abe9-a4eeba55f013 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:44.838931 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d4674ff9-82fb-49b1-abe9-a4eeba55f013 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.158006 Sep 06 04:45:44.839763 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 536/1050] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:44 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:45.568692 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b76835d4-4057-4f16-9eff-043a6d1f7df5 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:45.569367 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b76835d4-4057-4f16-9eff-043a6d1f7df5 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:45.575879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b76835d4-4057-4f16-9eff-043a6d1f7df5 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:45.576371 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b76835d4-4057-4f16-9eff-043a6d1f7df5 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:45.577410 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b76835d4-4057-4f16-9eff-043a6d1f7df5 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:45.578113 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b76835d4-4057-4f16-9eff-043a6d1f7df5 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:45.578577 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b76835d4-4057-4f16-9eff-043a6d1f7df5 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:45.579001 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b76835d4-4057-4f16-9eff-043a6d1f7df5 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:45.587682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8f91ef3f-f1a4-4eb4-a089-62b82616e759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:45.588276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8f91ef3f-f1a4-4eb4-a089-62b82616e759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:45.595543 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f91ef3f-f1a4-4eb4-a089-62b82616e759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:45.596103 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f91ef3f-f1a4-4eb4-a089-62b82616e759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:45.596546 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f91ef3f-f1a4-4eb4-a089-62b82616e759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:45.597529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f91ef3f-f1a4-4eb4-a089-62b82616e759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:45.597997 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f91ef3f-f1a4-4eb4-a089-62b82616e759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:45.598432 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8f91ef3f-f1a4-4eb4-a089-62b82616e759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:45.748049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b76835d4-4057-4f16-9eff-043a6d1f7df5 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:45.756486 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b76835d4-4057-4f16-9eff-043a6d1f7df5 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1759 microversion: 2.1 time: 0.191704 Sep 06 04:45:45.757268 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 515/1051] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:45 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:45.761808 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ff1674ed-fe98-40e1-90c4-5f489be32902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:45.762574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ff1674ed-fe98-40e1-90c4-5f489be32902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:45.768808 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff1674ed-fe98-40e1-90c4-5f489be32902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:45.769285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff1674ed-fe98-40e1-90c4-5f489be32902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:45.769956 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff1674ed-fe98-40e1-90c4-5f489be32902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:45.770803 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff1674ed-fe98-40e1-90c4-5f489be32902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:45.771410 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff1674ed-fe98-40e1-90c4-5f489be32902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:45.771826 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ff1674ed-fe98-40e1-90c4-5f489be32902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:45.836341 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8f91ef3f-f1a4-4eb4-a089-62b82616e759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:45.849239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8f91ef3f-f1a4-4eb4-a089-62b82616e759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:45.849239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8f91ef3f-f1a4-4eb4-a089-62b82616e759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:45.849239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8f91ef3f-f1a4-4eb4-a089-62b82616e759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1746 microversion: 2.20 time: 0.266755 Sep 06 04:45:45.850149 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 537/1052] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:45 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1746 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:45:45.863562 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ff1674ed-fe98-40e1-90c4-5f489be32902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:45.867474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-813bdc86-7091-42bb-b02e-dfc013e4ee12 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:45.868315 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-813bdc86-7091-42bb-b02e-dfc013e4ee12 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:45.875692 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ff1674ed-fe98-40e1-90c4-5f489be32902 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1209 microversion: 2.1 time: 0.117020 Sep 06 04:45:45.876347 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-813bdc86-7091-42bb-b02e-dfc013e4ee12 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:45.876682 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 516/1053] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:45 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1209 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:45.877209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-813bdc86-7091-42bb-b02e-dfc013e4ee12 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:45.877678 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-813bdc86-7091-42bb-b02e-dfc013e4ee12 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:45.878392 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-813bdc86-7091-42bb-b02e-dfc013e4ee12 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:45.878850 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-813bdc86-7091-42bb-b02e-dfc013e4ee12 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:45.879274 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-813bdc86-7091-42bb-b02e-dfc013e4ee12 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:46.088330 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-813bdc86-7091-42bb-b02e-dfc013e4ee12 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:46.096954 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-813bdc86-7091-42bb-b02e-dfc013e4ee12 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.236214 Sep 06 04:45:46.096954 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 538/1054] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:45 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:46.876243 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9912c49b-c7ff-49c0-9714-08f6f10ec379 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:46.876786 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9912c49b-c7ff-49c0-9714-08f6f10ec379 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:46.883145 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9912c49b-c7ff-49c0-9714-08f6f10ec379 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:46.885727 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9912c49b-c7ff-49c0-9714-08f6f10ec379 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:46.885727 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9912c49b-c7ff-49c0-9714-08f6f10ec379 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:46.885727 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9912c49b-c7ff-49c0-9714-08f6f10ec379 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:46.885727 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9912c49b-c7ff-49c0-9714-08f6f10ec379 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:46.886125 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9912c49b-c7ff-49c0-9714-08f6f10ec379 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:46.899850 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e2cc1a7f-fdba-4d8d-80b9-54a36a361e81 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:46.901550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e2cc1a7f-fdba-4d8d-80b9-54a36a361e81 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:46.908813 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=90 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:46.910728 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2cc1a7f-fdba-4d8d-80b9-54a36a361e81 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:46.914431 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2cc1a7f-fdba-4d8d-80b9-54a36a361e81 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:46.914431 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2cc1a7f-fdba-4d8d-80b9-54a36a361e81 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:46.914431 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2cc1a7f-fdba-4d8d-80b9-54a36a361e81 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:46.914431 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2cc1a7f-fdba-4d8d-80b9-54a36a361e81 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:46.914870 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e2cc1a7f-fdba-4d8d-80b9-54a36a361e81 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:47.021562 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9912c49b-c7ff-49c0-9714-08f6f10ec379 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:47.030248 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9912c49b-c7ff-49c0-9714-08f6f10ec379 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:47.031825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9912c49b-c7ff-49c0-9714-08f6f10ec379 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:47.032990 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9912c49b-c7ff-49c0-9714-08f6f10ec379 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1746 microversion: 2.20 time: 0.160846 Sep 06 04:45:47.033591 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 517/1055] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:46 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:47.120281 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9aa01d87-5074-4f9f-8535-df28baa5c7c0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:47.120933 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9aa01d87-5074-4f9f-8535-df28baa5c7c0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:47.122937 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:47.128054 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9aa01d87-5074-4f9f-8535-df28baa5c7c0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:47.128461 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9aa01d87-5074-4f9f-8535-df28baa5c7c0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:47.128953 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9aa01d87-5074-4f9f-8535-df28baa5c7c0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:47.129690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9aa01d87-5074-4f9f-8535-df28baa5c7c0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:47.130166 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9aa01d87-5074-4f9f-8535-df28baa5c7c0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:47.130580 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9aa01d87-5074-4f9f-8535-df28baa5c7c0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:47.274768 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9aa01d87-5074-4f9f-8535-df28baa5c7c0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:47.283310 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9aa01d87-5074-4f9f-8535-df28baa5c7c0 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.166959 Sep 06 04:45:47.283909 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 518/1056] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:47 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:47.366059 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e2cc1a7f-fdba-4d8d-80b9-54a36a361e81 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:47.374462 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e2cc1a7f-fdba-4d8d-80b9-54a36a361e81 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1277 microversion: 2.1 time: 0.478633 Sep 06 04:45:47.375034 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 539/1057] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:46 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1277 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:47.628752 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-d81f444e-78ec-47fe-bb83-a8c25384937a req-8c3ed635-5255-485e-85e5-3a385606e3a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17758d6d-93d6-48b1-890f-eca1a0fe0058", "tag": "0f636c18-fb41-4c1e-b52b-868f0f44b336"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:47.639530 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d81f444e-78ec-47fe-bb83-a8c25384937a req-8c3ed635-5255-485e-85e5-3a385606e3a7 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:47.640608 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d81f444e-78ec-47fe-bb83-a8c25384937a req-8c3ed635-5255-485e-85e5-3a385606e3a7 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:47.641043 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d81f444e-78ec-47fe-bb83-a8c25384937a req-8c3ed635-5255-485e-85e5-3a385606e3a7 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:47.652326 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-d81f444e-78ec-47fe-bb83-a8c25384937a req-8c3ed635-5255-485e-85e5-3a385606e3a7 service nova] Creating event network-changed:0f636c18-fb41-4c1e-b52b-868f0f44b336 for instance 17758d6d-93d6-48b1-890f-eca1a0fe0058 on hv-cinder-85600 Sep 06 04:45:47.658686 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-d81f444e-78ec-47fe-bb83-a8c25384937a req-8c3ed635-5255-485e-85e5-3a385606e3a7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034074 Sep 06 04:45:47.659284 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 519/1058] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:45:48.059100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d3a70356-3530-4def-a6e1-67d53a03e31d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:48.059705 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d3a70356-3530-4def-a6e1-67d53a03e31d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:48.066909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3a70356-3530-4def-a6e1-67d53a03e31d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:48.067401 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3a70356-3530-4def-a6e1-67d53a03e31d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:48.067841 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3a70356-3530-4def-a6e1-67d53a03e31d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:48.068539 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3a70356-3530-4def-a6e1-67d53a03e31d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:48.068993 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3a70356-3530-4def-a6e1-67d53a03e31d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:48.069444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d3a70356-3530-4def-a6e1-67d53a03e31d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:48.298286 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d3a70356-3530-4def-a6e1-67d53a03e31d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:48.308186 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5001f19f-8188-427c-a9c8-4714f814e84a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:48.310098 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5001f19f-8188-427c-a9c8-4714f814e84a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:48.321844 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d3a70356-3530-4def-a6e1-67d53a03e31d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:48.324434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5001f19f-8188-427c-a9c8-4714f814e84a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:48.324920 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5001f19f-8188-427c-a9c8-4714f814e84a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:48.325372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5001f19f-8188-427c-a9c8-4714f814e84a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:48.326068 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5001f19f-8188-427c-a9c8-4714f814e84a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:48.326576 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5001f19f-8188-427c-a9c8-4714f814e84a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:48.326993 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5001f19f-8188-427c-a9c8-4714f814e84a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:48.330659 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d3a70356-3530-4def-a6e1-67d53a03e31d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:48.331851 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d3a70356-3530-4def-a6e1-67d53a03e31d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1746 microversion: 2.20 time: 0.276724 Sep 06 04:45:48.332715 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 540/1059] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:48 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1746 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:48.405910 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-abd832b9-08d5-4a9a-9c86-a506fbd68562 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:48.405910 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-abd832b9-08d5-4a9a-9c86-a506fbd68562 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:48.408293 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abd832b9-08d5-4a9a-9c86-a506fbd68562 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:48.409034 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abd832b9-08d5-4a9a-9c86-a506fbd68562 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:48.409668 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abd832b9-08d5-4a9a-9c86-a506fbd68562 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:48.410686 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abd832b9-08d5-4a9a-9c86-a506fbd68562 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:48.411342 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abd832b9-08d5-4a9a-9c86-a506fbd68562 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:48.412232 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-abd832b9-08d5-4a9a-9c86-a506fbd68562 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:48.430166 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:48.449656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=12 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:48.488510 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5001f19f-8188-427c-a9c8-4714f814e84a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:48.500510 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5001f19f-8188-427c-a9c8-4714f814e84a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.195845 Sep 06 04:45:48.502432 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 520/1060] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:48 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:48.591683 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-f11b150b-e329-45a5-8879-9e5cb75390d0 req-f65a13e8-7641-43de-8867-0f77443e635b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acc63ec5-2ef0-416d-957a-76e83eb7a5c0", "name": "network-vif-plugged", "status": "completed", "tag": "9d2e20a6-91b7-4e08-b9cc-3a354079b32c"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:48.603532 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-f11b150b-e329-45a5-8879-9e5cb75390d0 req-f65a13e8-7641-43de-8867-0f77443e635b service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:48.604484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-f11b150b-e329-45a5-8879-9e5cb75390d0 req-f65a13e8-7641-43de-8867-0f77443e635b service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:48.605440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-f11b150b-e329-45a5-8879-9e5cb75390d0 req-f65a13e8-7641-43de-8867-0f77443e635b service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:48.621431 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-f11b150b-e329-45a5-8879-9e5cb75390d0 req-f65a13e8-7641-43de-8867-0f77443e635b service nova] Creating event network-vif-plugged:9d2e20a6-91b7-4e08-b9cc-3a354079b32c for instance acc63ec5-2ef0-416d-957a-76e83eb7a5c0 on hv-cinder-85600 Sep 06 04:45:48.624615 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-abd832b9-08d5-4a9a-9c86-a506fbd68562 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:48.627864 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-f11b150b-e329-45a5-8879-9e5cb75390d0 req-f65a13e8-7641-43de-8867-0f77443e635b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040344 Sep 06 04:45:48.628467 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 521/1061] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:45:48.635072 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-abd832b9-08d5-4a9a-9c86-a506fbd68562 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.241397 Sep 06 04:45:48.635640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 541/1062] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:48 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:49.357433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0b0d2176-7a3e-4f60-a763-7b277fbbb11e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:49.358657 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0b0d2176-7a3e-4f60-a763-7b277fbbb11e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:49.365034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b0d2176-7a3e-4f60-a763-7b277fbbb11e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:49.365552 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b0d2176-7a3e-4f60-a763-7b277fbbb11e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:49.366117 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b0d2176-7a3e-4f60-a763-7b277fbbb11e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:49.366815 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b0d2176-7a3e-4f60-a763-7b277fbbb11e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:49.367267 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b0d2176-7a3e-4f60-a763-7b277fbbb11e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:49.367718 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0b0d2176-7a3e-4f60-a763-7b277fbbb11e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:49.495762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0b0d2176-7a3e-4f60-a763-7b277fbbb11e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:49.504317 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0b0d2176-7a3e-4f60-a763-7b277fbbb11e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:49.505803 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0b0d2176-7a3e-4f60-a763-7b277fbbb11e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:49.506954 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0b0d2176-7a3e-4f60-a763-7b277fbbb11e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1746 microversion: 2.20 time: 0.154421 Sep 06 04:45:49.507515 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 522/1063] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:49 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:49.525126 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-46de4075-5a36-4b90-990b-6b7c92332974 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:49.525770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-46de4075-5a36-4b90-990b-6b7c92332974 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:49.527640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:49.533112 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46de4075-5a36-4b90-990b-6b7c92332974 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:49.533634 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46de4075-5a36-4b90-990b-6b7c92332974 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:49.534075 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46de4075-5a36-4b90-990b-6b7c92332974 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:49.534760 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46de4075-5a36-4b90-990b-6b7c92332974 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:49.535218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46de4075-5a36-4b90-990b-6b7c92332974 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:49.535639 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-46de4075-5a36-4b90-990b-6b7c92332974 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:49.659993 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6fcbe849-564f-4e9e-a4c0-e8888e664143 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:49.661709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6fcbe849-564f-4e9e-a4c0-e8888e664143 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:49.666500 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fcbe849-564f-4e9e-a4c0-e8888e664143 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:49.666980 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fcbe849-564f-4e9e-a4c0-e8888e664143 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:49.667413 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fcbe849-564f-4e9e-a4c0-e8888e664143 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:49.668164 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fcbe849-564f-4e9e-a4c0-e8888e664143 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:49.668612 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fcbe849-564f-4e9e-a4c0-e8888e664143 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:49.669060 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fcbe849-564f-4e9e-a4c0-e8888e664143 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:49.669765 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-46de4075-5a36-4b90-990b-6b7c92332974 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:49.678175 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-46de4075-5a36-4b90-990b-6b7c92332974 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.156847 Sep 06 04:45:49.684625 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 542/1064] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:49 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:49.805498 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6fcbe849-564f-4e9e-a4c0-e8888e664143 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:49.813778 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6fcbe849-564f-4e9e-a4c0-e8888e664143 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.157683 Sep 06 04:45:49.814334 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 523/1065] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:49 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:50.532871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-00a08640-c6f6-4a04-ae83-68f1e0a3dd90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:50.533551 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-00a08640-c6f6-4a04-ae83-68f1e0a3dd90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:50.540064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00a08640-c6f6-4a04-ae83-68f1e0a3dd90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:50.540552 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00a08640-c6f6-4a04-ae83-68f1e0a3dd90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:50.540995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00a08640-c6f6-4a04-ae83-68f1e0a3dd90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:50.541722 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00a08640-c6f6-4a04-ae83-68f1e0a3dd90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:50.542172 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00a08640-c6f6-4a04-ae83-68f1e0a3dd90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:50.542593 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-00a08640-c6f6-4a04-ae83-68f1e0a3dd90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:50.643200 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-7ebf5691-f53d-41bf-ae56-18aa8db0daf7 req-a1184e2c-82d6-4518-8a12-cbbca1a0fda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821737e4-9236-4f80-b1ac-8c4d16c02244", "name": "network-vif-plugged", "status": "completed", "tag": "3e4ec09b-2a4b-41e0-871c-50fd282365c6"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:50.652494 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7ebf5691-f53d-41bf-ae56-18aa8db0daf7 req-a1184e2c-82d6-4518-8a12-cbbca1a0fda6 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:50.652948 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7ebf5691-f53d-41bf-ae56-18aa8db0daf7 req-a1184e2c-82d6-4518-8a12-cbbca1a0fda6 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:50.653388 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-7ebf5691-f53d-41bf-ae56-18aa8db0daf7 req-a1184e2c-82d6-4518-8a12-cbbca1a0fda6 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:50.665403 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-7ebf5691-f53d-41bf-ae56-18aa8db0daf7 req-a1184e2c-82d6-4518-8a12-cbbca1a0fda6 service nova] Creating event network-vif-plugged:3e4ec09b-2a4b-41e0-871c-50fd282365c6 for instance 821737e4-9236-4f80-b1ac-8c4d16c02244 on hv-cinder-85600 Sep 06 04:45:50.670220 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-00a08640-c6f6-4a04-ae83-68f1e0a3dd90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:50.670474 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-7ebf5691-f53d-41bf-ae56-18aa8db0daf7 req-a1184e2c-82d6-4518-8a12-cbbca1a0fda6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032068 Sep 06 04:45:50.671001 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 524/1066] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:45:50.681416 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-00a08640-c6f6-4a04-ae83-68f1e0a3dd90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:50.682852 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-00a08640-c6f6-4a04-ae83-68f1e0a3dd90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:50.684161 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-00a08640-c6f6-4a04-ae83-68f1e0a3dd90 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1746 microversion: 2.20 time: 0.155981 Sep 06 04:45:50.684714 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 543/1067] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:50 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:50.703765 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b379f029-5a0a-4bfb-bf19-de1f645333da tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:50.704468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b379f029-5a0a-4bfb-bf19-de1f645333da tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:50.710757 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b379f029-5a0a-4bfb-bf19-de1f645333da tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:50.711236 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b379f029-5a0a-4bfb-bf19-de1f645333da tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:50.711669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b379f029-5a0a-4bfb-bf19-de1f645333da tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:50.712360 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b379f029-5a0a-4bfb-bf19-de1f645333da tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:50.712809 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b379f029-5a0a-4bfb-bf19-de1f645333da tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:50.713226 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b379f029-5a0a-4bfb-bf19-de1f645333da tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:50.839768 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7348a2c8-3884-4558-8c80-18b93b934af7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:50.846775 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7348a2c8-3884-4558-8c80-18b93b934af7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:50.853011 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7348a2c8-3884-4558-8c80-18b93b934af7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:50.853475 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b379f029-5a0a-4bfb-bf19-de1f645333da tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:50.853618 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7348a2c8-3884-4558-8c80-18b93b934af7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:50.854021 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7348a2c8-3884-4558-8c80-18b93b934af7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:50.854734 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7348a2c8-3884-4558-8c80-18b93b934af7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:50.855199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7348a2c8-3884-4558-8c80-18b93b934af7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:50.855810 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7348a2c8-3884-4558-8c80-18b93b934af7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:50.861439 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b379f029-5a0a-4bfb-bf19-de1f645333da tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.163279 Sep 06 04:45:50.873665 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 525/1068] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:50 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:50.996516 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7348a2c8-3884-4558-8c80-18b93b934af7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:51.005328 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7348a2c8-3884-4558-8c80-18b93b934af7 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.172942 Sep 06 04:45:51.005887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 544/1069] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:50 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:51.710211 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ac0fcb8f-0323-4ab3-a6e2-8ce3c259d335 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:51.711025 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ac0fcb8f-0323-4ab3-a6e2-8ce3c259d335 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:51.717467 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac0fcb8f-0323-4ab3-a6e2-8ce3c259d335 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:51.718096 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac0fcb8f-0323-4ab3-a6e2-8ce3c259d335 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:51.718524 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac0fcb8f-0323-4ab3-a6e2-8ce3c259d335 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:51.719208 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac0fcb8f-0323-4ab3-a6e2-8ce3c259d335 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:51.719655 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac0fcb8f-0323-4ab3-a6e2-8ce3c259d335 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:51.720068 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ac0fcb8f-0323-4ab3-a6e2-8ce3c259d335 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:51.847980 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ac0fcb8f-0323-4ab3-a6e2-8ce3c259d335 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:51.856008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ac0fcb8f-0323-4ab3-a6e2-8ce3c259d335 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:51.857538 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ac0fcb8f-0323-4ab3-a6e2-8ce3c259d335 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:51.858861 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ac0fcb8f-0323-4ab3-a6e2-8ce3c259d335 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1746 microversion: 2.20 time: 0.152635 Sep 06 04:45:51.859419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 526/1070] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:51 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:51.885158 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5c53e6de-94c8-44bc-9287-9a7882b2c95a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:51.885859 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5c53e6de-94c8-44bc-9287-9a7882b2c95a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:51.892272 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c53e6de-94c8-44bc-9287-9a7882b2c95a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:51.892753 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c53e6de-94c8-44bc-9287-9a7882b2c95a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:51.893184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c53e6de-94c8-44bc-9287-9a7882b2c95a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:51.893889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c53e6de-94c8-44bc-9287-9a7882b2c95a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:51.894341 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c53e6de-94c8-44bc-9287-9a7882b2c95a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:51.894759 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5c53e6de-94c8-44bc-9287-9a7882b2c95a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:52.020815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5c53e6de-94c8-44bc-9287-9a7882b2c95a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:52.027823 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7740ba92-afa8-4ea0-ad5b-3249f59e342e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:52.028469 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7740ba92-afa8-4ea0-ad5b-3249f59e342e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:52.028861 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5c53e6de-94c8-44bc-9287-9a7882b2c95a tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1314 microversion: 2.1 time: 0.147476 Sep 06 04:45:52.030453 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 545/1071] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:51 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:52.035507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7740ba92-afa8-4ea0-ad5b-3249f59e342e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:52.035996 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7740ba92-afa8-4ea0-ad5b-3249f59e342e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:52.036435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7740ba92-afa8-4ea0-ad5b-3249f59e342e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:52.037133 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7740ba92-afa8-4ea0-ad5b-3249f59e342e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:52.037616 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7740ba92-afa8-4ea0-ad5b-3249f59e342e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:52.038228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7740ba92-afa8-4ea0-ad5b-3249f59e342e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:52.174311 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7740ba92-afa8-4ea0-ad5b-3249f59e342e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:52.185693 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7740ba92-afa8-4ea0-ad5b-3249f59e342e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.157768 Sep 06 04:45:52.185693 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 527/1072] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:52 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:52.884288 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-66b1a559-685f-4724-8a40-a5c0600e9aba tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:52.884886 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-66b1a559-685f-4724-8a40-a5c0600e9aba tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:52.892296 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66b1a559-685f-4724-8a40-a5c0600e9aba tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:52.892887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66b1a559-685f-4724-8a40-a5c0600e9aba tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:52.893289 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66b1a559-685f-4724-8a40-a5c0600e9aba tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:52.894109 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66b1a559-685f-4724-8a40-a5c0600e9aba tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:52.894566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66b1a559-685f-4724-8a40-a5c0600e9aba tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:52.894979 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66b1a559-685f-4724-8a40-a5c0600e9aba tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:53.026747 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-66b1a559-685f-4724-8a40-a5c0600e9aba tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:53.035744 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-66b1a559-685f-4724-8a40-a5c0600e9aba tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:53.037198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-66b1a559-685f-4724-8a40-a5c0600e9aba tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:53.038403 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-66b1a559-685f-4724-8a40-a5c0600e9aba tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1741 microversion: 2.20 time: 0.157959 Sep 06 04:45:53.038954 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 546/1073] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:52 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:53.052120 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a4073584-d081-4cc1-baed-f45079f6a2eb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:53.052734 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a4073584-d081-4cc1-baed-f45079f6a2eb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:53.059199 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4073584-d081-4cc1-baed-f45079f6a2eb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:53.059679 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4073584-d081-4cc1-baed-f45079f6a2eb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:53.060122 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4073584-d081-4cc1-baed-f45079f6a2eb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:53.060804 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4073584-d081-4cc1-baed-f45079f6a2eb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:53.061253 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4073584-d081-4cc1-baed-f45079f6a2eb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:53.062234 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a4073584-d081-4cc1-baed-f45079f6a2eb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:53.195885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a4073584-d081-4cc1-baed-f45079f6a2eb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:53.204583 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a4073584-d081-4cc1-baed-f45079f6a2eb tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1498 microversion: 2.1 time: 0.156316 Sep 06 04:45:53.205158 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 528/1074] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:53 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:53.206795 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-32224550-9f1e-46dc-a256-d2c37961ccd5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:53.207406 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-32224550-9f1e-46dc-a256-d2c37961ccd5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:53.214918 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32224550-9f1e-46dc-a256-d2c37961ccd5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:53.215403 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32224550-9f1e-46dc-a256-d2c37961ccd5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:53.215840 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32224550-9f1e-46dc-a256-d2c37961ccd5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:53.216652 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32224550-9f1e-46dc-a256-d2c37961ccd5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:53.217108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32224550-9f1e-46dc-a256-d2c37961ccd5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:53.217652 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-32224550-9f1e-46dc-a256-d2c37961ccd5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:53.358383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-32224550-9f1e-46dc-a256-d2c37961ccd5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:53.367039 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-32224550-9f1e-46dc-a256-d2c37961ccd5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.165022 Sep 06 04:45:53.367621 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 547/1075] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:53 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:54.066064 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0fb99b49-9888-4dae-93e1-f767061a4cbd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:54.067222 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0fb99b49-9888-4dae-93e1-f767061a4cbd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:54.087067 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fb99b49-9888-4dae-93e1-f767061a4cbd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:54.087565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fb99b49-9888-4dae-93e1-f767061a4cbd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:54.088003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fb99b49-9888-4dae-93e1-f767061a4cbd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:54.088793 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fb99b49-9888-4dae-93e1-f767061a4cbd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:54.089387 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fb99b49-9888-4dae-93e1-f767061a4cbd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:54.089880 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0fb99b49-9888-4dae-93e1-f767061a4cbd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:54.189998 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1a1e3e71-c249-4bf8-8e82-6a886363db2f tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:54.190614 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1a1e3e71-c249-4bf8-8e82-6a886363db2f tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:54.197879 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a1e3e71-c249-4bf8-8e82-6a886363db2f tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:54.198847 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a1e3e71-c249-4bf8-8e82-6a886363db2f tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:54.199477 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a1e3e71-c249-4bf8-8e82-6a886363db2f tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:54.200353 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a1e3e71-c249-4bf8-8e82-6a886363db2f tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:54.201108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a1e3e71-c249-4bf8-8e82-6a886363db2f tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:54.201716 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1a1e3e71-c249-4bf8-8e82-6a886363db2f tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:54.229477 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=100 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:54.234253 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1a1e3e71-c249-4bf8-8e82-6a886363db2f tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:45:54.263054 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0fb99b49-9888-4dae-93e1-f767061a4cbd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:54.273864 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0fb99b49-9888-4dae-93e1-f767061a4cbd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:54.275330 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0fb99b49-9888-4dae-93e1-f767061a4cbd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:54.276523 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0fb99b49-9888-4dae-93e1-f767061a4cbd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1741 microversion: 2.20 time: 0.216013 Sep 06 04:45:54.277330 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 529/1076] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:54 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1741 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:45:54.392901 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d44ef3ec-bf37-497c-8ef2-647987dbc415 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:54.393850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d44ef3ec-bf37-497c-8ef2-647987dbc415 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:54.400074 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d44ef3ec-bf37-497c-8ef2-647987dbc415 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:54.400535 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d44ef3ec-bf37-497c-8ef2-647987dbc415 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:54.400969 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d44ef3ec-bf37-497c-8ef2-647987dbc415 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:54.401688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d44ef3ec-bf37-497c-8ef2-647987dbc415 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:54.402317 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d44ef3ec-bf37-497c-8ef2-647987dbc415 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:54.402905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d44ef3ec-bf37-497c-8ef2-647987dbc415 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:54.486077 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1a1e3e71-c249-4bf8-8e82-6a886363db2f tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "DELETE /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 204 len: 0 microversion: 2.1 time: 0.299811 Sep 06 04:45:54.486857 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 548/1077] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:45:54 2022] DELETE /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 06 04:45:54.496452 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-05b0265b-cffc-49bc-be19-3334e2ac2bee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:54.497779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-05b0265b-cffc-49bc-be19-3334e2ac2bee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:54.507047 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-05b0265b-cffc-49bc-be19-3334e2ac2bee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:54.507855 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-05b0265b-cffc-49bc-be19-3334e2ac2bee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:54.508353 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-05b0265b-cffc-49bc-be19-3334e2ac2bee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:54.509118 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-05b0265b-cffc-49bc-be19-3334e2ac2bee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:54.509666 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-05b0265b-cffc-49bc-be19-3334e2ac2bee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:54.510171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-05b0265b-cffc-49bc-be19-3334e2ac2bee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:54.591837 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d44ef3ec-bf37-497c-8ef2-647987dbc415 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:54.602142 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d44ef3ec-bf37-497c-8ef2-647987dbc415 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.213732 Sep 06 04:45:54.604408 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 530/1078] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:54 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:54.664271 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-05b0265b-cffc-49bc-be19-3334e2ac2bee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:54.704370 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-05b0265b-cffc-49bc-be19-3334e2ac2bee tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1504 microversion: 2.1 time: 0.211727 Sep 06 04:45:54.732746 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 549/1079] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:54 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:55.324341 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4d968aa6-5f59-49b5-a9e0-632624a57f8f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:55.325047 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4d968aa6-5f59-49b5-a9e0-632624a57f8f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:55.334301 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d968aa6-5f59-49b5-a9e0-632624a57f8f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:55.335148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d968aa6-5f59-49b5-a9e0-632624a57f8f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:55.336106 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d968aa6-5f59-49b5-a9e0-632624a57f8f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:55.337204 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d968aa6-5f59-49b5-a9e0-632624a57f8f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:55.338036 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d968aa6-5f59-49b5-a9e0-632624a57f8f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:55.339454 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d968aa6-5f59-49b5-a9e0-632624a57f8f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:55.498596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4d968aa6-5f59-49b5-a9e0-632624a57f8f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:55.508499 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4d968aa6-5f59-49b5-a9e0-632624a57f8f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:55.510033 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4d968aa6-5f59-49b5-a9e0-632624a57f8f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:55.511254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4d968aa6-5f59-49b5-a9e0-632624a57f8f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1741 microversion: 2.20 time: 0.192388 Sep 06 04:45:55.511813 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 531/1080] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:55 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:55.628664 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7299af10-1427-483b-8dfb-00f2738e42ee tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:55.629429 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7299af10-1427-483b-8dfb-00f2738e42ee tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:55.636150 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7299af10-1427-483b-8dfb-00f2738e42ee tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:55.636636 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7299af10-1427-483b-8dfb-00f2738e42ee tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:55.637274 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7299af10-1427-483b-8dfb-00f2738e42ee tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:55.638010 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7299af10-1427-483b-8dfb-00f2738e42ee tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:55.638468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7299af10-1427-483b-8dfb-00f2738e42ee tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:55.638896 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7299af10-1427-483b-8dfb-00f2738e42ee tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:55.758056 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e0adf935-b2b8-4e32-b1a5-db96f9e31c51 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:55.758987 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e0adf935-b2b8-4e32-b1a5-db96f9e31c51 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:55.767341 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0adf935-b2b8-4e32-b1a5-db96f9e31c51 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:55.767855 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0adf935-b2b8-4e32-b1a5-db96f9e31c51 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:55.768312 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0adf935-b2b8-4e32-b1a5-db96f9e31c51 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:55.769930 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0adf935-b2b8-4e32-b1a5-db96f9e31c51 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:55.770578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0adf935-b2b8-4e32-b1a5-db96f9e31c51 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:55.771176 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e0adf935-b2b8-4e32-b1a5-db96f9e31c51 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:55.794678 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7299af10-1427-483b-8dfb-00f2738e42ee tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:55.809201 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7299af10-1427-483b-8dfb-00f2738e42ee tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.184343 Sep 06 04:45:55.815973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 550/1081] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:55 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:55.938761 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-e0adf935-b2b8-4e32-b1a5-db96f9e31c51 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:55.946578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e0adf935-b2b8-4e32-b1a5-db96f9e31c51 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1504 microversion: 2.1 time: 0.193547 Sep 06 04:45:55.947227 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 532/1082] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:55 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1504 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:56.537608 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-57afa865-2ef3-4e81-a759-6c0fc0705380 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:56.538411 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-57afa865-2ef3-4e81-a759-6c0fc0705380 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:56.544740 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-57afa865-2ef3-4e81-a759-6c0fc0705380 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:56.545231 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-57afa865-2ef3-4e81-a759-6c0fc0705380 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:56.545693 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-57afa865-2ef3-4e81-a759-6c0fc0705380 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:56.547554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-57afa865-2ef3-4e81-a759-6c0fc0705380 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:56.548019 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-57afa865-2ef3-4e81-a759-6c0fc0705380 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:56.548451 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-57afa865-2ef3-4e81-a759-6c0fc0705380 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:56.692522 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-57afa865-2ef3-4e81-a759-6c0fc0705380 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:56.702614 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-57afa865-2ef3-4e81-a759-6c0fc0705380 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:56.704273 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-57afa865-2ef3-4e81-a759-6c0fc0705380 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:56.705885 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-57afa865-2ef3-4e81-a759-6c0fc0705380 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1741 microversion: 2.20 time: 0.172338 Sep 06 04:45:56.721741 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 551/1083] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:56 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1741 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:56.837773 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a3d0588a-8064-45fe-bf28-1b7008fe42ed tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:56.843551 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a3d0588a-8064-45fe-bf28-1b7008fe42ed tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:56.850868 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3d0588a-8064-45fe-bf28-1b7008fe42ed tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:56.856688 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3d0588a-8064-45fe-bf28-1b7008fe42ed tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:56.857567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3d0588a-8064-45fe-bf28-1b7008fe42ed tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:56.858623 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3d0588a-8064-45fe-bf28-1b7008fe42ed tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:56.859302 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3d0588a-8064-45fe-bf28-1b7008fe42ed tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:56.859956 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a3d0588a-8064-45fe-bf28-1b7008fe42ed tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:56.864823 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=100 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:45:56.973250 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d4b49499-3a48-4149-b79a-60d9c2316b15 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:56.974529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d4b49499-3a48-4149-b79a-60d9c2316b15 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:56.981674 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4b49499-3a48-4149-b79a-60d9c2316b15 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:56.982546 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4b49499-3a48-4149-b79a-60d9c2316b15 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:56.983290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4b49499-3a48-4149-b79a-60d9c2316b15 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:56.985341 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4b49499-3a48-4149-b79a-60d9c2316b15 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:56.986140 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4b49499-3a48-4149-b79a-60d9c2316b15 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:56.986784 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d4b49499-3a48-4149-b79a-60d9c2316b15 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:57.144607 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a3d0588a-8064-45fe-bf28-1b7008fe42ed tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:57.155046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a3d0588a-8064-45fe-bf28-1b7008fe42ed tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.324744 Sep 06 04:45:57.162936 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d4b49499-3a48-4149-b79a-60d9c2316b15 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:57.188062 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 533/1084] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:56 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:57.189008 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d4b49499-3a48-4149-b79a-60d9c2316b15 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1504 microversion: 2.1 time: 0.203020 Sep 06 04:45:57.190041 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 552/1085] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:56 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:57.732166 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-95362bcd-d53d-4604-8e80-35b5df2f7fc7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:57.732859 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-95362bcd-d53d-4604-8e80-35b5df2f7fc7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:57.738929 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95362bcd-d53d-4604-8e80-35b5df2f7fc7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:57.739468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95362bcd-d53d-4604-8e80-35b5df2f7fc7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:57.739901 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95362bcd-d53d-4604-8e80-35b5df2f7fc7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:57.741120 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95362bcd-d53d-4604-8e80-35b5df2f7fc7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:57.741120 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95362bcd-d53d-4604-8e80-35b5df2f7fc7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:57.741533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-95362bcd-d53d-4604-8e80-35b5df2f7fc7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:57.951781 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-95362bcd-d53d-4604-8e80-35b5df2f7fc7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:57.961175 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-95362bcd-d53d-4604-8e80-35b5df2f7fc7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:57.962946 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-95362bcd-d53d-4604-8e80-35b5df2f7fc7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:57.964198 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-95362bcd-d53d-4604-8e80-35b5df2f7fc7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1741 microversion: 2.20 time: 0.236044 Sep 06 04:45:57.964833 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 534/1086] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:57 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1741 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:58.086436 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-b32ec915-88bf-4bdc-8a2d-6d46e2bb6f05 req-73330bb3-e52a-454c-a1f6-d51e0871914f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acc63ec5-2ef0-416d-957a-76e83eb7a5c0", "name": "network-vif-deleted", "tag": "9d2e20a6-91b7-4e08-b9cc-3a354079b32c"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:58.101577 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b32ec915-88bf-4bdc-8a2d-6d46e2bb6f05 req-73330bb3-e52a-454c-a1f6-d51e0871914f service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:58.102360 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b32ec915-88bf-4bdc-8a2d-6d46e2bb6f05 req-73330bb3-e52a-454c-a1f6-d51e0871914f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:58.103163 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b32ec915-88bf-4bdc-8a2d-6d46e2bb6f05 req-73330bb3-e52a-454c-a1f6-d51e0871914f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:58.116930 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-b32ec915-88bf-4bdc-8a2d-6d46e2bb6f05 req-73330bb3-e52a-454c-a1f6-d51e0871914f service nova] Creating event network-vif-deleted:9d2e20a6-91b7-4e08-b9cc-3a354079b32c for instance acc63ec5-2ef0-416d-957a-76e83eb7a5c0 on hv-cinder-85600 Sep 06 04:45:58.122849 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-b32ec915-88bf-4bdc-8a2d-6d46e2bb6f05 req-73330bb3-e52a-454c-a1f6-d51e0871914f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040190 Sep 06 04:45:58.127684 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 553/1087] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:45:58.183687 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cb69e0b4-a889-4462-b6ea-9f27af799d05 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:58.184129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cb69e0b4-a889-4462-b6ea-9f27af799d05 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:58.189103 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-1284fc62-18f0-4247-9ae0-25042d24de61 req-9f4d29e0-1cd0-4fee-87a3-1c23e80dceac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddad572e-12e1-4699-ba46-16c1ccb25704", "tag": "784c9a84-7d0f-461b-810d-b0f2b91e1d43"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:45:58.199622 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb69e0b4-a889-4462-b6ea-9f27af799d05 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:58.201996 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb69e0b4-a889-4462-b6ea-9f27af799d05 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:58.203011 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-1284fc62-18f0-4247-9ae0-25042d24de61 req-9f4d29e0-1cd0-4fee-87a3-1c23e80dceac service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:58.203369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb69e0b4-a889-4462-b6ea-9f27af799d05 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:58.204090 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb69e0b4-a889-4462-b6ea-9f27af799d05 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:58.204343 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-1284fc62-18f0-4247-9ae0-25042d24de61 req-9f4d29e0-1cd0-4fee-87a3-1c23e80dceac service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:58.204552 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb69e0b4-a889-4462-b6ea-9f27af799d05 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:58.205448 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-1284fc62-18f0-4247-9ae0-25042d24de61 req-9f4d29e0-1cd0-4fee-87a3-1c23e80dceac service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:58.207354 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cb69e0b4-a889-4462-b6ea-9f27af799d05 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:58.223713 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-1284fc62-18f0-4247-9ae0-25042d24de61 req-9f4d29e0-1cd0-4fee-87a3-1c23e80dceac service nova] Creating event network-changed:784c9a84-7d0f-461b-810d-b0f2b91e1d43 for instance ddad572e-12e1-4699-ba46-16c1ccb25704 on hv-cinder-85600 Sep 06 04:45:58.229900 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-1284fc62-18f0-4247-9ae0-25042d24de61 req-9f4d29e0-1cd0-4fee-87a3-1c23e80dceac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046845 Sep 06 04:45:58.231276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 554/1088] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:45:58.240499 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a5fa668c-2992-4244-be12-c2870ea1be10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:58.241565 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a5fa668c-2992-4244-be12-c2870ea1be10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:58.254110 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5fa668c-2992-4244-be12-c2870ea1be10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:58.255039 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5fa668c-2992-4244-be12-c2870ea1be10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:58.255737 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5fa668c-2992-4244-be12-c2870ea1be10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:58.258168 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5fa668c-2992-4244-be12-c2870ea1be10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:58.258924 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5fa668c-2992-4244-be12-c2870ea1be10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:58.259570 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5fa668c-2992-4244-be12-c2870ea1be10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:58.275458 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cb69e0b4-a889-4462-b6ea-9f27af799d05 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:45:58.586831 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a5fa668c-2992-4244-be12-c2870ea1be10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:58.600521 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a5fa668c-2992-4244-be12-c2870ea1be10 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.365648 Sep 06 04:45:58.604693 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 555/1089] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:58 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:58.616640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9066c19d-df09-4bae-b778-51aa1db8e0b8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:58.620428 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cb69e0b4-a889-4462-b6ea-9f27af799d05 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 204 len: 0 microversion: 2.1 time: 0.440733 Sep 06 04:45:58.621019 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 535/1090] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:45:58 2022] DELETE /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:45:58.621529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9066c19d-df09-4bae-b778-51aa1db8e0b8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:58.630709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d7d2a42e-d5b2-4b74-9c63-5cbb25dfd1b1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:58.637490 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d7d2a42e-d5b2-4b74-9c63-5cbb25dfd1b1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:58.638276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9066c19d-df09-4bae-b778-51aa1db8e0b8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:58.640756 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9066c19d-df09-4bae-b778-51aa1db8e0b8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:58.646749 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9066c19d-df09-4bae-b778-51aa1db8e0b8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:58.648241 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9066c19d-df09-4bae-b778-51aa1db8e0b8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:58.651779 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9066c19d-df09-4bae-b778-51aa1db8e0b8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:58.657378 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7d2a42e-d5b2-4b74-9c63-5cbb25dfd1b1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:58.657378 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7d2a42e-d5b2-4b74-9c63-5cbb25dfd1b1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:58.660186 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7d2a42e-d5b2-4b74-9c63-5cbb25dfd1b1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:58.661262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7d2a42e-d5b2-4b74-9c63-5cbb25dfd1b1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:58.662512 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7d2a42e-d5b2-4b74-9c63-5cbb25dfd1b1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:58.664068 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9066c19d-df09-4bae-b778-51aa1db8e0b8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:58.664634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d7d2a42e-d5b2-4b74-9c63-5cbb25dfd1b1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:58.770532 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9066c19d-df09-4bae-b778-51aa1db8e0b8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:58.771289 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9066c19d-df09-4bae-b778-51aa1db8e0b8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:58.771904 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9066c19d-df09-4bae-b778-51aa1db8e0b8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:58.772532 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-9066c19d-df09-4bae-b778-51aa1db8e0b8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lazy-loading 'fault' on Instance uuid acc63ec5-2ef0-416d-957a-76e83eb7a5c0 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:45:58.829889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-9066c19d-df09-4bae-b778-51aa1db8e0b8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:58.841724 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9066c19d-df09-4bae-b778-51aa1db8e0b8 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1304 microversion: 2.1 time: 0.234674 Sep 06 04:45:58.857736 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d7d2a42e-d5b2-4b74-9c63-5cbb25dfd1b1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:58.861148 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 556/1091] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:58 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1304 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:58.873185 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d7d2a42e-d5b2-4b74-9c63-5cbb25dfd1b1 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.246562 Sep 06 04:45:58.877007 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 536/1092] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:58 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:45:58.991609 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-472f3a0e-12af-4e29-828b-dda066bdfdfd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:58.992474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-472f3a0e-12af-4e29-828b-dda066bdfdfd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:59.000239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-472f3a0e-12af-4e29-828b-dda066bdfdfd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:59.000718 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-472f3a0e-12af-4e29-828b-dda066bdfdfd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:59.001150 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-472f3a0e-12af-4e29-828b-dda066bdfdfd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:59.002049 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-472f3a0e-12af-4e29-828b-dda066bdfdfd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:59.002649 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-472f3a0e-12af-4e29-828b-dda066bdfdfd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:59.003406 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-472f3a0e-12af-4e29-828b-dda066bdfdfd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:59.157746 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-472f3a0e-12af-4e29-828b-dda066bdfdfd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:59.168269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-472f3a0e-12af-4e29-828b-dda066bdfdfd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:59.169786 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-472f3a0e-12af-4e29-828b-dda066bdfdfd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:59.171034 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-472f3a0e-12af-4e29-828b-dda066bdfdfd tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1741 microversion: 2.20 time: 0.185069 Sep 06 04:45:59.171611 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 557/1093] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:45:58 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:45:59.626332 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d403c5d5-f0c0-44d9-9ff7-5cbf48345170 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:59.627075 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d403c5d5-f0c0-44d9-9ff7-5cbf48345170 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:59.635097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d403c5d5-f0c0-44d9-9ff7-5cbf48345170 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:59.636453 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d403c5d5-f0c0-44d9-9ff7-5cbf48345170 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:59.637065 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d403c5d5-f0c0-44d9-9ff7-5cbf48345170 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:59.637882 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d403c5d5-f0c0-44d9-9ff7-5cbf48345170 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:59.638416 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d403c5d5-f0c0-44d9-9ff7-5cbf48345170 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:59.638917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d403c5d5-f0c0-44d9-9ff7-5cbf48345170 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:59.807076 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d403c5d5-f0c0-44d9-9ff7-5cbf48345170 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:45:59.816871 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d403c5d5-f0c0-44d9-9ff7-5cbf48345170 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.195623 Sep 06 04:45:59.817710 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 537/1094] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:59 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:45:59.873598 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5f1d0cff-ccfa-4fc5-b5af-1f7d16d362f9 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:59.875174 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5f1d0cff-ccfa-4fc5-b5af-1f7d16d362f9 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:59.883194 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f1d0cff-ccfa-4fc5-b5af-1f7d16d362f9 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:59.883990 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f1d0cff-ccfa-4fc5-b5af-1f7d16d362f9 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:59.884769 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f1d0cff-ccfa-4fc5-b5af-1f7d16d362f9 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:59.886237 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f1d0cff-ccfa-4fc5-b5af-1f7d16d362f9 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:59.887009 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f1d0cff-ccfa-4fc5-b5af-1f7d16d362f9 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:59.887707 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f1d0cff-ccfa-4fc5-b5af-1f7d16d362f9 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:59.900290 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ef62a950-456c-41c1-8dfc-de012a029180 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:45:59.901684 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ef62a950-456c-41c1-8dfc-de012a029180 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:45:59.910115 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef62a950-456c-41c1-8dfc-de012a029180 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:59.911224 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef62a950-456c-41c1-8dfc-de012a029180 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:59.911841 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef62a950-456c-41c1-8dfc-de012a029180 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:59.912910 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef62a950-456c-41c1-8dfc-de012a029180 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:59.913680 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef62a950-456c-41c1-8dfc-de012a029180 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:59.914266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ef62a950-456c-41c1-8dfc-de012a029180 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:59.935847 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f1d0cff-ccfa-4fc5-b5af-1f7d16d362f9 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:45:59.937360 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f1d0cff-ccfa-4fc5-b5af-1f7d16d362f9 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:45:59.937908 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5f1d0cff-ccfa-4fc5-b5af-1f7d16d362f9 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:45:59.938474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-5f1d0cff-ccfa-4fc5-b5af-1f7d16d362f9 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lazy-loading 'fault' on Instance uuid acc63ec5-2ef0-416d-957a-76e83eb7a5c0 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:46:00.044291 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5f1d0cff-ccfa-4fc5-b5af-1f7d16d362f9 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:00.056294 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5f1d0cff-ccfa-4fc5-b5af-1f7d16d362f9 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1304 microversion: 2.1 time: 0.187129 Sep 06 04:46:00.069339 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 558/1095] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:59 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1304 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:00.111719 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ef62a950-456c-41c1-8dfc-de012a029180 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:00.119079 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ef62a950-456c-41c1-8dfc-de012a029180 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1566 microversion: 2.1 time: 0.222589 Sep 06 04:46:00.119852 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 538/1096] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:45:59 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1566 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:00.197694 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3182d377-dd09-41a2-8a51-0f7ae474b1f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:00.200358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3182d377-dd09-41a2-8a51-0f7ae474b1f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:00.210856 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3182d377-dd09-41a2-8a51-0f7ae474b1f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:00.211353 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3182d377-dd09-41a2-8a51-0f7ae474b1f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:00.211831 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3182d377-dd09-41a2-8a51-0f7ae474b1f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:00.219525 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3182d377-dd09-41a2-8a51-0f7ae474b1f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:00.220009 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3182d377-dd09-41a2-8a51-0f7ae474b1f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:00.221178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3182d377-dd09-41a2-8a51-0f7ae474b1f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:00.400365 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3182d377-dd09-41a2-8a51-0f7ae474b1f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:00.410110 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3182d377-dd09-41a2-8a51-0f7ae474b1f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:00.411898 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3182d377-dd09-41a2-8a51-0f7ae474b1f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:00.413079 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3182d377-dd09-41a2-8a51-0f7ae474b1f9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1741 microversion: 2.20 time: 0.219481 Sep 06 04:46:00.413851 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 559/1097] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:00 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1741 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:46:00.840139 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-68b78391-9c3e-4d88-9466-d03932afaf54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:00.841450 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-68b78391-9c3e-4d88-9466-d03932afaf54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:00.850421 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68b78391-9c3e-4d88-9466-d03932afaf54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:00.852434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68b78391-9c3e-4d88-9466-d03932afaf54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:00.853466 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68b78391-9c3e-4d88-9466-d03932afaf54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:00.854384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68b78391-9c3e-4d88-9466-d03932afaf54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:00.855011 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68b78391-9c3e-4d88-9466-d03932afaf54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:00.855617 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68b78391-9c3e-4d88-9466-d03932afaf54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:01.038940 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-68b78391-9c3e-4d88-9466-d03932afaf54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:01.048250 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-68b78391-9c3e-4d88-9466-d03932afaf54 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.211949 Sep 06 04:46:01.052742 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 539/1098] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:00 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:01.084071 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-02901e3d-f9bf-4956-86c3-674909b02610 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:01.085014 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-02901e3d-f9bf-4956-86c3-674909b02610 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:01.099208 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02901e3d-f9bf-4956-86c3-674909b02610 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:01.100238 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02901e3d-f9bf-4956-86c3-674909b02610 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:01.100920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02901e3d-f9bf-4956-86c3-674909b02610 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:01.102019 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02901e3d-f9bf-4956-86c3-674909b02610 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:01.102822 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02901e3d-f9bf-4956-86c3-674909b02610 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:01.103462 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02901e3d-f9bf-4956-86c3-674909b02610 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:01.145365 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8f850627-27d2-43ae-9045-613bf6c14059 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:01.146161 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8f850627-27d2-43ae-9045-613bf6c14059 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:01.157682 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f850627-27d2-43ae-9045-613bf6c14059 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:01.163607 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f850627-27d2-43ae-9045-613bf6c14059 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:01.163607 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f850627-27d2-43ae-9045-613bf6c14059 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:01.164090 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f850627-27d2-43ae-9045-613bf6c14059 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:01.164796 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f850627-27d2-43ae-9045-613bf6c14059 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:01.165490 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8f850627-27d2-43ae-9045-613bf6c14059 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:01.170484 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02901e3d-f9bf-4956-86c3-674909b02610 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:01.171015 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02901e3d-f9bf-4956-86c3-674909b02610 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:01.171455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-02901e3d-f9bf-4956-86c3-674909b02610 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:01.171913 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-02901e3d-f9bf-4956-86c3-674909b02610 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lazy-loading 'fault' on Instance uuid acc63ec5-2ef0-416d-957a-76e83eb7a5c0 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:46:01.233174 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-02901e3d-f9bf-4956-86c3-674909b02610 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84150d0100be498b84f4b9a54525a986', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f758de124e64932af3cc80ed348f51c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:01.247266 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-02901e3d-f9bf-4956-86c3-674909b02610 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 200 len: 1304 microversion: 2.1 time: 0.168396 Sep 06 04:46:01.254147 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 560/1099] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:01 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 1304 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:01.439730 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-aada049a-a8cd-4192-8e5a-87dae68bda92 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:01.440354 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-aada049a-a8cd-4192-8e5a-87dae68bda92 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:01.451099 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aada049a-a8cd-4192-8e5a-87dae68bda92 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:01.592480 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aada049a-a8cd-4192-8e5a-87dae68bda92 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:01.592480 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aada049a-a8cd-4192-8e5a-87dae68bda92 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:01.592480 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aada049a-a8cd-4192-8e5a-87dae68bda92 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:01.592480 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aada049a-a8cd-4192-8e5a-87dae68bda92 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:01.594601 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aada049a-a8cd-4192-8e5a-87dae68bda92 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:01.594822 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8f850627-27d2-43ae-9045-613bf6c14059 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:01.594822 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8f850627-27d2-43ae-9045-613bf6c14059 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1448 microversion: 2.1 time: 0.348654 Sep 06 04:46:01.594822 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 540/1100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:01 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1448 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:01.676659 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-aada049a-a8cd-4192-8e5a-87dae68bda92 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:01.684816 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-aada049a-a8cd-4192-8e5a-87dae68bda92 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:01.686331 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-aada049a-a8cd-4192-8e5a-87dae68bda92 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:01.688122 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-aada049a-a8cd-4192-8e5a-87dae68bda92 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1741 microversion: 2.20 time: 0.253114 Sep 06 04:46:01.688689 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 561/1101] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:01 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1741 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:01.951723 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-67ebb3a8-16d7-44cd-a516-6a28744b5179 req-9e9fc2e3-8234-454d-93a4-18ab59e80b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddad572e-12e1-4699-ba46-16c1ccb25704", "name": "network-vif-deleted", "tag": "784c9a84-7d0f-461b-810d-b0f2b91e1d43"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:46:01.963328 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-67ebb3a8-16d7-44cd-a516-6a28744b5179 req-9e9fc2e3-8234-454d-93a4-18ab59e80b92 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:01.963816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-67ebb3a8-16d7-44cd-a516-6a28744b5179 req-9e9fc2e3-8234-454d-93a4-18ab59e80b92 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:01.964385 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-67ebb3a8-16d7-44cd-a516-6a28744b5179 req-9e9fc2e3-8234-454d-93a4-18ab59e80b92 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:01.977339 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-67ebb3a8-16d7-44cd-a516-6a28744b5179 req-9e9fc2e3-8234-454d-93a4-18ab59e80b92 service nova] Creating event network-vif-deleted:784c9a84-7d0f-461b-810d-b0f2b91e1d43 for instance ddad572e-12e1-4699-ba46-16c1ccb25704 on hv-cinder-85600 Sep 06 04:46:01.982564 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-67ebb3a8-16d7-44cd-a516-6a28744b5179 req-9e9fc2e3-8234-454d-93a4-18ab59e80b92 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034417 Sep 06 04:46:01.984107 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 541/1102] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:46:02.144873 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d8dfea04-a2da-4692-a863-613afa0fa493 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:02.145715 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d8dfea04-a2da-4692-a863-613afa0fa493 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:02.154713 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8dfea04-a2da-4692-a863-613afa0fa493 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:02.156552 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8dfea04-a2da-4692-a863-613afa0fa493 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:02.156552 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8dfea04-a2da-4692-a863-613afa0fa493 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:02.156789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8dfea04-a2da-4692-a863-613afa0fa493 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:02.157214 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8dfea04-a2da-4692-a863-613afa0fa493 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:02.157659 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d8dfea04-a2da-4692-a863-613afa0fa493 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:02.279560 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-847930ad-0c23-4de3-ae57-36d8ea9ed192 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:02.280311 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-847930ad-0c23-4de3-ae57-36d8ea9ed192 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] [instance: acc63ec5-2ef0-416d-957a-76e83eb7a5c0] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:02.293873 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-847930ad-0c23-4de3-ae57-36d8ea9ed192 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:02.294399 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-847930ad-0c23-4de3-ae57-36d8ea9ed192 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:02.294846 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-847930ad-0c23-4de3-ae57-36d8ea9ed192 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:02.295585 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-847930ad-0c23-4de3-ae57-36d8ea9ed192 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:02.296170 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-847930ad-0c23-4de3-ae57-36d8ea9ed192 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:02.296601 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-847930ad-0c23-4de3-ae57-36d8ea9ed192 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:02.326586 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-847930ad-0c23-4de3-ae57-36d8ea9ed192 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] HTTP exception thrown: Instance acc63ec5-2ef0-416d-957a-76e83eb7a5c0 could not be found. Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-847930ad-0c23-4de3-ae57-36d8ea9ed192 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Request method failure captured: Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 HTTP/1.1 Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFtBRNL2Aaaa-XiEE-UZNy8PE7lOlyjfI4Q5xb3xvGOjYjaB0NAX-YceDWraFgHuMgTf-uPwGlnGt1nNHCYxpSGvFWJsiRkEq14krg66F69nctkJpFVpDG7_nYu2D9ae-TxRRfLqAsaA1O4KQLcO7TW5dSC_YxKP8NC6Kni7AT3BeCtM Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 5f758de124e64932af3cc80ed348f51c Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesActionsTest-1765501802 Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:46:02.328397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:46:02.329874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5f758de124e64932af3cc80ed348f51c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5f758de124e64932af3cc80ed348f51c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5f758de124e64932af3cc80ed348f51c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5f758de124e64932af3cc80ed348f51c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:46:02.329874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesActionsTest-1765501802 Sep 06 04:46:02.329874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 5f758de124e64932af3cc80ed348f51c Sep 06 04:46:02.329874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesActionsTest-1765501802 Sep 06 04:46:02.329874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesActionsTest-1765501802-project Sep 06 04:46:02.329874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:46:02.329874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:46:02.329874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 84150d0100be498b84f4b9a54525a986 Sep 06 04:46:02.329874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesActionsTest-1765501802-project Sep 06 04:46:02.329874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:46:02.329874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance acc63ec5-2ef0-416d-957a-76e83eb7a5c0 could not be found. Sep 06 04:46:02.329874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': 'acc63ec5-2ef0-416d-957a-76e83eb7a5c0'} Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acc63ec5-2ef0-416d-957a-76e83eb7a5c0 could not be found. Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:46:02.330690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acc63ec5-2ef0-416d-957a-76e83eb7a5c0 could not be found. Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acc63ec5-2ef0-416d-957a-76e83eb7a5c0 could not be found. Sep 06 04:46:02.332900 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:46:02.334400 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-847930ad-0c23-4de3-ae57-36d8ea9ed192 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] Returning 404 to user: Instance acc63ec5-2ef0-416d-957a-76e83eb7a5c0 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:46:02.334400 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-847930ad-0c23-4de3-ae57-36d8ea9ed192 tempest-VolumesActionsTest-1765501802 tempest-VolumesActionsTest-1765501802-project] 10.222.0.30 "GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0" status: 404 len: 111 microversion: 2.1 time: 0.054853 Sep 06 04:46:02.334400 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 542/1103] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:02 2022] GET /compute/v2.1/servers/acc63ec5-2ef0-416d-957a-76e83eb7a5c0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 04:46:02.369009 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d8dfea04-a2da-4692-a863-613afa0fa493 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:02.379298 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d8dfea04-a2da-4692-a863-613afa0fa493 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.238461 Sep 06 04:46:02.390206 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 562/1104] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:02 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:02.522964 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1394b7a6-e62a-4581-b62e-578862146b4a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:02.523721 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1394b7a6-e62a-4581-b62e-578862146b4a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:02.530233 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1394b7a6-e62a-4581-b62e-578862146b4a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:02.530721 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1394b7a6-e62a-4581-b62e-578862146b4a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:02.531156 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1394b7a6-e62a-4581-b62e-578862146b4a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:02.531849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1394b7a6-e62a-4581-b62e-578862146b4a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:02.532305 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1394b7a6-e62a-4581-b62e-578862146b4a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:02.532724 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1394b7a6-e62a-4581-b62e-578862146b4a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:02.612449 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1394b7a6-e62a-4581-b62e-578862146b4a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:02.620291 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1394b7a6-e62a-4581-b62e-578862146b4a tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1218 microversion: 2.1 time: 0.101008 Sep 06 04:46:02.621106 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 543/1105] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:02 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:02.724959 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-66545eb9-a50a-4ed2-a5f9-b4cf2d2979c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:02.727799 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-66545eb9-a50a-4ed2-a5f9-b4cf2d2979c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:02.741375 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66545eb9-a50a-4ed2-a5f9-b4cf2d2979c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:02.741947 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66545eb9-a50a-4ed2-a5f9-b4cf2d2979c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:02.742393 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66545eb9-a50a-4ed2-a5f9-b4cf2d2979c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:02.743131 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66545eb9-a50a-4ed2-a5f9-b4cf2d2979c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:02.743602 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66545eb9-a50a-4ed2-a5f9-b4cf2d2979c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:02.744443 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-66545eb9-a50a-4ed2-a5f9-b4cf2d2979c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:02.783327 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:46:02.944037 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-66545eb9-a50a-4ed2-a5f9-b4cf2d2979c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:02.953205 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-66545eb9-a50a-4ed2-a5f9-b4cf2d2979c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:02.954863 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-66545eb9-a50a-4ed2-a5f9-b4cf2d2979c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:02.956184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-66545eb9-a50a-4ed2-a5f9-b4cf2d2979c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1741 microversion: 2.20 time: 0.235313 Sep 06 04:46:02.956834 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 563/1106] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:02 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1741 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:03.105531 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-cce0dfe4-9d30-4f9f-8e16-3674307aff25 req-35159e34-7dce-49d9-8d98-710e870c547a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17758d6d-93d6-48b1-890f-eca1a0fe0058", "name": "network-vif-plugged", "status": "completed", "tag": "0f636c18-fb41-4c1e-b52b-868f0f44b336"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:46:03.120008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-cce0dfe4-9d30-4f9f-8e16-3674307aff25 req-35159e34-7dce-49d9-8d98-710e870c547a service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:03.120008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-cce0dfe4-9d30-4f9f-8e16-3674307aff25 req-35159e34-7dce-49d9-8d98-710e870c547a service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:03.120008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-cce0dfe4-9d30-4f9f-8e16-3674307aff25 req-35159e34-7dce-49d9-8d98-710e870c547a service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:03.133019 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-cce0dfe4-9d30-4f9f-8e16-3674307aff25 req-35159e34-7dce-49d9-8d98-710e870c547a service nova] Creating event network-vif-plugged:0f636c18-fb41-4c1e-b52b-868f0f44b336 for instance 17758d6d-93d6-48b1-890f-eca1a0fe0058 on hv-cinder-85600 Sep 06 04:46:03.145286 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-cce0dfe4-9d30-4f9f-8e16-3674307aff25 req-35159e34-7dce-49d9-8d98-710e870c547a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042770 Sep 06 04:46:03.149447 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 544/1107] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:46:03.408419 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-f256350a-4e92-4d74-93b0-e53e0857eaae tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:03.409659 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-f256350a-4e92-4d74-93b0-e53e0857eaae tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:03.417545 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f256350a-4e92-4d74-93b0-e53e0857eaae tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:03.418264 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f256350a-4e92-4d74-93b0-e53e0857eaae tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:03.418798 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f256350a-4e92-4d74-93b0-e53e0857eaae tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:03.419613 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f256350a-4e92-4d74-93b0-e53e0857eaae tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:03.420147 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f256350a-4e92-4d74-93b0-e53e0857eaae tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:03.420798 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-f256350a-4e92-4d74-93b0-e53e0857eaae tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:03.617909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-f256350a-4e92-4d74-93b0-e53e0857eaae tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:03.645649 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6ff5807d-aa58-44bb-8b12-4c744adff08b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:03.646081 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-f256350a-4e92-4d74-93b0-e53e0857eaae tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.245051 Sep 06 04:46:03.646363 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6ff5807d-aa58-44bb-8b12-4c744adff08b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:03.646886 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 564/1108] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:03 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:03.665422 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ff5807d-aa58-44bb-8b12-4c744adff08b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:03.669606 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ff5807d-aa58-44bb-8b12-4c744adff08b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:03.669606 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ff5807d-aa58-44bb-8b12-4c744adff08b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:03.669606 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ff5807d-aa58-44bb-8b12-4c744adff08b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:03.669606 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ff5807d-aa58-44bb-8b12-4c744adff08b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:03.670028 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ff5807d-aa58-44bb-8b12-4c744adff08b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:03.724979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ff5807d-aa58-44bb-8b12-4c744adff08b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:03.725908 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ff5807d-aa58-44bb-8b12-4c744adff08b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:03.726717 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ff5807d-aa58-44bb-8b12-4c744adff08b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:03.727407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-6ff5807d-aa58-44bb-8b12-4c744adff08b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lazy-loading 'fault' on Instance uuid ddad572e-12e1-4699-ba46-16c1ccb25704 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:46:03.773562 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6ff5807d-aa58-44bb-8b12-4c744adff08b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:03.782197 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6ff5807d-aa58-44bb-8b12-4c744adff08b tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1223 microversion: 2.1 time: 0.141457 Sep 06 04:46:03.782892 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 545/1109] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:03 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1223 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:03.986724 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8e211521-089f-4c0d-8e4a-5a1b8888025a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:03.988231 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8e211521-089f-4c0d-8e4a-5a1b8888025a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:03.999910 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e211521-089f-4c0d-8e4a-5a1b8888025a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:04.000421 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e211521-089f-4c0d-8e4a-5a1b8888025a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:04.000919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e211521-089f-4c0d-8e4a-5a1b8888025a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:04.002664 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e211521-089f-4c0d-8e4a-5a1b8888025a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:04.003127 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e211521-089f-4c0d-8e4a-5a1b8888025a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:04.004573 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8e211521-089f-4c0d-8e4a-5a1b8888025a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:04.189745 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8e211521-089f-4c0d-8e4a-5a1b8888025a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:04.204476 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8e211521-089f-4c0d-8e4a-5a1b8888025a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:04.205959 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8e211521-089f-4c0d-8e4a-5a1b8888025a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:04.207480 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8e211521-089f-4c0d-8e4a-5a1b8888025a tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1741 microversion: 2.20 time: 0.226219 Sep 06 04:46:04.208058 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 565/1110] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:03 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1741 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:04.674364 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9e9bbb5a-6b2e-44a0-87ba-199c358f8e16 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:04.675755 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9e9bbb5a-6b2e-44a0-87ba-199c358f8e16 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:04.684521 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e9bbb5a-6b2e-44a0-87ba-199c358f8e16 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:04.685127 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e9bbb5a-6b2e-44a0-87ba-199c358f8e16 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:04.685779 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e9bbb5a-6b2e-44a0-87ba-199c358f8e16 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:04.689070 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e9bbb5a-6b2e-44a0-87ba-199c358f8e16 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:04.690990 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e9bbb5a-6b2e-44a0-87ba-199c358f8e16 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:04.691612 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e9bbb5a-6b2e-44a0-87ba-199c358f8e16 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:04.815022 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c06123f5-b3fc-4aec-81f9-3e2a7a16269e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:04.817013 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c06123f5-b3fc-4aec-81f9-3e2a7a16269e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:04.831897 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c06123f5-b3fc-4aec-81f9-3e2a7a16269e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:04.832508 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c06123f5-b3fc-4aec-81f9-3e2a7a16269e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:04.833023 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c06123f5-b3fc-4aec-81f9-3e2a7a16269e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:04.833841 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c06123f5-b3fc-4aec-81f9-3e2a7a16269e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:04.834367 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c06123f5-b3fc-4aec-81f9-3e2a7a16269e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:04.835415 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c06123f5-b3fc-4aec-81f9-3e2a7a16269e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:04.877275 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9e9bbb5a-6b2e-44a0-87ba-199c358f8e16 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:04.888689 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9e9bbb5a-6b2e-44a0-87ba-199c358f8e16 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.220947 Sep 06 04:46:04.893473 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 546/1111] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:04 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:04.898786 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c06123f5-b3fc-4aec-81f9-3e2a7a16269e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:04.898786 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c06123f5-b3fc-4aec-81f9-3e2a7a16269e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:04.899158 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c06123f5-b3fc-4aec-81f9-3e2a7a16269e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:04.899627 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-c06123f5-b3fc-4aec-81f9-3e2a7a16269e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lazy-loading 'fault' on Instance uuid ddad572e-12e1-4699-ba46-16c1ccb25704 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:46:04.952615 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c06123f5-b3fc-4aec-81f9-3e2a7a16269e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:04.961099 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c06123f5-b3fc-4aec-81f9-3e2a7a16269e tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1223 microversion: 2.1 time: 0.155081 Sep 06 04:46:04.962230 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 566/1112] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:04 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1223 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:05.236467 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-00576c5f-551e-4359-97bb-ff05ce6208da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:05.236997 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-00576c5f-551e-4359-97bb-ff05ce6208da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:05.243476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00576c5f-551e-4359-97bb-ff05ce6208da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:05.244008 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00576c5f-551e-4359-97bb-ff05ce6208da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:05.244438 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00576c5f-551e-4359-97bb-ff05ce6208da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:05.245172 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00576c5f-551e-4359-97bb-ff05ce6208da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:05.245724 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00576c5f-551e-4359-97bb-ff05ce6208da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:05.246145 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-00576c5f-551e-4359-97bb-ff05ce6208da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:05.405090 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-00576c5f-551e-4359-97bb-ff05ce6208da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:05.414015 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-00576c5f-551e-4359-97bb-ff05ce6208da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:05.415492 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-00576c5f-551e-4359-97bb-ff05ce6208da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:05.416804 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-00576c5f-551e-4359-97bb-ff05ce6208da tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1741 microversion: 2.20 time: 0.185329 Sep 06 04:46:05.417415 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 547/1113] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:05 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:05.926008 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ad3a8390-cf2c-4322-b199-437d0411a369 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:05.926557 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ad3a8390-cf2c-4322-b199-437d0411a369 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:05.933078 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad3a8390-cf2c-4322-b199-437d0411a369 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:05.933646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad3a8390-cf2c-4322-b199-437d0411a369 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:05.934083 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad3a8390-cf2c-4322-b199-437d0411a369 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:05.934768 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad3a8390-cf2c-4322-b199-437d0411a369 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:05.935219 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad3a8390-cf2c-4322-b199-437d0411a369 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:05.935639 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ad3a8390-cf2c-4322-b199-437d0411a369 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:05.984183 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f8138753-502b-4df3-971d-54fce8c864b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:05.986402 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f8138753-502b-4df3-971d-54fce8c864b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:05.992092 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f8138753-502b-4df3-971d-54fce8c864b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:05.992573 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f8138753-502b-4df3-971d-54fce8c864b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:05.993011 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f8138753-502b-4df3-971d-54fce8c864b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:05.993738 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f8138753-502b-4df3-971d-54fce8c864b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:05.994187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f8138753-502b-4df3-971d-54fce8c864b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:05.994604 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f8138753-502b-4df3-971d-54fce8c864b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:06.027069 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f8138753-502b-4df3-971d-54fce8c864b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:06.027624 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f8138753-502b-4df3-971d-54fce8c864b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:06.028061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f8138753-502b-4df3-971d-54fce8c864b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:06.028511 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-f8138753-502b-4df3-971d-54fce8c864b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lazy-loading 'fault' on Instance uuid ddad572e-12e1-4699-ba46-16c1ccb25704 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:46:06.071661 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f8138753-502b-4df3-971d-54fce8c864b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:06.073275 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ad3a8390-cf2c-4322-b199-437d0411a369 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:06.080909 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f8138753-502b-4df3-971d-54fce8c864b0 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1223 microversion: 2.1 time: 0.100790 Sep 06 04:46:06.081736 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 548/1114] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:05 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:46:06.083132 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ad3a8390-cf2c-4322-b199-437d0411a369 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.161316 Sep 06 04:46:06.083799 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 567/1115] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:05 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:06.443354 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c7a69d66-18a8-4d82-8cd1-60550e5954a5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:06.444245 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c7a69d66-18a8-4d82-8cd1-60550e5954a5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:06.450656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7a69d66-18a8-4d82-8cd1-60550e5954a5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:06.451390 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7a69d66-18a8-4d82-8cd1-60550e5954a5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:06.452395 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7a69d66-18a8-4d82-8cd1-60550e5954a5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:06.453111 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7a69d66-18a8-4d82-8cd1-60550e5954a5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:06.453593 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7a69d66-18a8-4d82-8cd1-60550e5954a5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:06.454018 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c7a69d66-18a8-4d82-8cd1-60550e5954a5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:06.474857 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:46:06.601370 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c7a69d66-18a8-4d82-8cd1-60550e5954a5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:06.610138 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c7a69d66-18a8-4d82-8cd1-60550e5954a5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:06.611701 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c7a69d66-18a8-4d82-8cd1-60550e5954a5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:06.612937 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c7a69d66-18a8-4d82-8cd1-60550e5954a5 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1741 microversion: 2.20 time: 0.173487 Sep 06 04:46:06.613606 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 549/1116] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:06 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1741 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:07.105358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e1c8177d-9a1b-4ed2-aac7-d57e041a36ba tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:07.106564 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e1c8177d-9a1b-4ed2-aac7-d57e041a36ba tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:07.112090 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0027ab24-6659-4e1e-a4cd-0bbf5e62b6e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:07.112829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0027ab24-6659-4e1e-a4cd-0bbf5e62b6e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:07.116213 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1c8177d-9a1b-4ed2-aac7-d57e041a36ba tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:07.116705 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1c8177d-9a1b-4ed2-aac7-d57e041a36ba tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:07.117381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1c8177d-9a1b-4ed2-aac7-d57e041a36ba tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:07.118038 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1c8177d-9a1b-4ed2-aac7-d57e041a36ba tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:07.118504 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1c8177d-9a1b-4ed2-aac7-d57e041a36ba tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:07.119007 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1c8177d-9a1b-4ed2-aac7-d57e041a36ba tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:07.122454 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0027ab24-6659-4e1e-a4cd-0bbf5e62b6e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:07.122949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0027ab24-6659-4e1e-a4cd-0bbf5e62b6e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:07.124167 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0027ab24-6659-4e1e-a4cd-0bbf5e62b6e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:07.124925 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0027ab24-6659-4e1e-a4cd-0bbf5e62b6e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:07.125768 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0027ab24-6659-4e1e-a4cd-0bbf5e62b6e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:07.126207 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0027ab24-6659-4e1e-a4cd-0bbf5e62b6e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:07.162160 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1c8177d-9a1b-4ed2-aac7-d57e041a36ba tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:07.162498 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1c8177d-9a1b-4ed2-aac7-d57e041a36ba tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:07.162932 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e1c8177d-9a1b-4ed2-aac7-d57e041a36ba tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:07.163502 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-e1c8177d-9a1b-4ed2-aac7-d57e041a36ba tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lazy-loading 'fault' on Instance uuid ddad572e-12e1-4699-ba46-16c1ccb25704 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:46:07.214349 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-e1c8177d-9a1b-4ed2-aac7-d57e041a36ba tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65a8d2df1eed492a874ddaae3235edd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17ca991debba43b98c1ad8f0f91c63a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:07.223048 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e1c8177d-9a1b-4ed2-aac7-d57e041a36ba tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 200 len: 1223 microversion: 2.1 time: 0.123089 Sep 06 04:46:07.223630 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 568/1117] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:07 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 1223 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:07.269200 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0027ab24-6659-4e1e-a4cd-0bbf5e62b6e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:07.276924 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0027ab24-6659-4e1e-a4cd-0bbf5e62b6e5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.174616 Sep 06 04:46:07.277514 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 550/1118] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:07 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:46:07.637935 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4a099020-048a-493e-a248-ab28f02255f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:07.638481 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4a099020-048a-493e-a248-ab28f02255f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:07.645212 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a099020-048a-493e-a248-ab28f02255f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:07.645728 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a099020-048a-493e-a248-ab28f02255f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:07.646159 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a099020-048a-493e-a248-ab28f02255f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:07.646835 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a099020-048a-493e-a248-ab28f02255f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:07.647286 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a099020-048a-493e-a248-ab28f02255f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:07.647732 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a099020-048a-493e-a248-ab28f02255f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:07.778046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4a099020-048a-493e-a248-ab28f02255f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:07.787869 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4a099020-048a-493e-a248-ab28f02255f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:07.789332 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4a099020-048a-493e-a248-ab28f02255f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:07.790486 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4a099020-048a-493e-a248-ab28f02255f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1741 microversion: 2.20 time: 0.156513 Sep 06 04:46:07.791051 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 569/1119] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:07 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:08.245756 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-879c8663-bd7f-4f08-a1d7-093aefb30399 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:08.246357 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-879c8663-bd7f-4f08-a1d7-093aefb30399 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] [instance: ddad572e-12e1-4699-ba46-16c1ccb25704] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:08.253385 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-879c8663-bd7f-4f08-a1d7-093aefb30399 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:08.253859 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-879c8663-bd7f-4f08-a1d7-093aefb30399 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:08.254283 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-879c8663-bd7f-4f08-a1d7-093aefb30399 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:08.254954 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-879c8663-bd7f-4f08-a1d7-093aefb30399 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:08.255397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-879c8663-bd7f-4f08-a1d7-093aefb30399 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:08.255808 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-879c8663-bd7f-4f08-a1d7-093aefb30399 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:08.269438 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-879c8663-bd7f-4f08-a1d7-093aefb30399 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] HTTP exception thrown: Instance ddad572e-12e1-4699-ba46-16c1ccb25704 could not be found. Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-879c8663-bd7f-4f08-a1d7-093aefb30399 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Request method failure captured: Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 HTTP/1.1 Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs7J5-XtuRKEic46sv-pRmVN3q3TVxat6KnxmQu0Rczefxn_BO6RfyuH4qjlT_9xwRb6AGh6qE67yvM9XpT_jkJwAISeYFAH7zwIUzHL2QsllryZKqlrfTFN4AD4GNJ7AS2FLK7ImZRQYU0jbzqRIZz24MbUesIBNQpRHnjW6ew0prY Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 17ca991debba43b98c1ad8f0f91c63a9 Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-TestShelveInstance-706558224 Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:46:08.271022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:46:08.272745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/17ca991debba43b98c1ad8f0f91c63a9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/17ca991debba43b98c1ad8f0f91c63a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_17ca991debba43b98c1ad8f0f91c63a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/17ca991debba43b98c1ad8f0f91c63a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:46:08.272745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-TestShelveInstance-706558224 Sep 06 04:46:08.272745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 17ca991debba43b98c1ad8f0f91c63a9 Sep 06 04:46:08.272745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-TestShelveInstance-706558224 Sep 06 04:46:08.272745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-TestShelveInstance-706558224-project Sep 06 04:46:08.272745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:46:08.272745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:46:08.272745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 65a8d2df1eed492a874ddaae3235edd0 Sep 06 04:46:08.272745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-TestShelveInstance-706558224-project Sep 06 04:46:08.272745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:46:08.272745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance ddad572e-12e1-4699-ba46-16c1ccb25704 could not be found. Sep 06 04:46:08.272745 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': 'ddad572e-12e1-4699-ba46-16c1ccb25704'} Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddad572e-12e1-4699-ba46-16c1ccb25704 could not be found. Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:46:08.273816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddad572e-12e1-4699-ba46-16c1ccb25704 could not be found. Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddad572e-12e1-4699-ba46-16c1ccb25704 could not be found. Sep 06 04:46:08.275372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:46:08.276765 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-879c8663-bd7f-4f08-a1d7-093aefb30399 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Returning 404 to user: Instance ddad572e-12e1-4699-ba46-16c1ccb25704 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:46:08.276765 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-879c8663-bd7f-4f08-a1d7-093aefb30399 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704" status: 404 len: 111 microversion: 2.1 time: 0.030434 Sep 06 04:46:08.276765 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 551/1120] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:08 2022] GET /compute/v2.1/servers/ddad572e-12e1-4699-ba46-16c1ccb25704 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:46:08.300012 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dccfd40d-eadc-41d5-9934-13436c3c0f2b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:08.300631 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dccfd40d-eadc-41d5-9934-13436c3c0f2b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:08.306645 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dccfd40d-eadc-41d5-9934-13436c3c0f2b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:08.307136 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dccfd40d-eadc-41d5-9934-13436c3c0f2b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:08.307577 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dccfd40d-eadc-41d5-9934-13436c3c0f2b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:08.308275 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dccfd40d-eadc-41d5-9934-13436c3c0f2b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:08.308734 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dccfd40d-eadc-41d5-9934-13436c3c0f2b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:08.309161 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dccfd40d-eadc-41d5-9934-13436c3c0f2b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:08.481100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-dccfd40d-eadc-41d5-9934-13436c3c0f2b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:08.489381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dccfd40d-eadc-41d5-9934-13436c3c0f2b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.193285 Sep 06 04:46:08.489958 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 570/1121] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:08 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:08.581293 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9c71310f-4e26-4b7f-812d-881a11eaeb52 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] Calling method '.version_select at 0x7f31766b91f0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:08.687097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9c71310f-4e26-4b7f-812d-881a11eaeb52 tempest-TestShelveInstance-706558224 tempest-TestShelveInstance-706558224-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-813257044" status: 202 len: 0 microversion: 2.1 time: 0.109430 Sep 06 04:46:08.687629 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 552/1122] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Sep 6 04:46:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-813257044 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:46:08.816517 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7c471b32-d26f-4327-a766-ef2fadea6759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:08.817658 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7c471b32-d26f-4327-a766-ef2fadea6759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:08.826005 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7c471b32-d26f-4327-a766-ef2fadea6759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:08.826660 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7c471b32-d26f-4327-a766-ef2fadea6759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:08.827377 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7c471b32-d26f-4327-a766-ef2fadea6759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:08.828481 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7c471b32-d26f-4327-a766-ef2fadea6759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:08.828981 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7c471b32-d26f-4327-a766-ef2fadea6759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:08.829654 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7c471b32-d26f-4327-a766-ef2fadea6759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:09.273465 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7c471b32-d26f-4327-a766-ef2fadea6759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:09.282601 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7c471b32-d26f-4327-a766-ef2fadea6759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:09.284036 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7c471b32-d26f-4327-a766-ef2fadea6759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:09.285214 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7c471b32-d26f-4327-a766-ef2fadea6759 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1741 microversion: 2.20 time: 0.473474 Sep 06 04:46:09.285803 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 571/1123] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:08 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1741 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:09.513797 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b8a96456-c79d-4fc1-bc7a-2f4d243d200e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:09.514395 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b8a96456-c79d-4fc1-bc7a-2f4d243d200e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:09.522005 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8a96456-c79d-4fc1-bc7a-2f4d243d200e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:09.522429 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8a96456-c79d-4fc1-bc7a-2f4d243d200e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:09.522866 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8a96456-c79d-4fc1-bc7a-2f4d243d200e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:09.523560 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8a96456-c79d-4fc1-bc7a-2f4d243d200e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:09.524016 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8a96456-c79d-4fc1-bc7a-2f4d243d200e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:09.524441 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b8a96456-c79d-4fc1-bc7a-2f4d243d200e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:09.653296 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b8a96456-c79d-4fc1-bc7a-2f4d243d200e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:09.661802 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b8a96456-c79d-4fc1-bc7a-2f4d243d200e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.152399 Sep 06 04:46:09.662363 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 553/1124] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:09 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:10.310608 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3e65936f-437e-4785-babd-fa2ae44e3368 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:10.325529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3e65936f-437e-4785-babd-fa2ae44e3368 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:10.325529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e65936f-437e-4785-babd-fa2ae44e3368 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:10.325529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e65936f-437e-4785-babd-fa2ae44e3368 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:10.325529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e65936f-437e-4785-babd-fa2ae44e3368 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:10.325985 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e65936f-437e-4785-babd-fa2ae44e3368 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:10.325985 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e65936f-437e-4785-babd-fa2ae44e3368 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:10.325985 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e65936f-437e-4785-babd-fa2ae44e3368 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:10.530628 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3e65936f-437e-4785-babd-fa2ae44e3368 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:10.539125 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3e65936f-437e-4785-babd-fa2ae44e3368 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:10.540565 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3e65936f-437e-4785-babd-fa2ae44e3368 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:10.541892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3e65936f-437e-4785-babd-fa2ae44e3368 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1741 microversion: 2.20 time: 0.235163 Sep 06 04:46:10.548045 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 572/1125] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:10 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1741 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:10.686283 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-79f44bd3-38be-45c3-839b-31711dcc76ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:10.687306 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-79f44bd3-38be-45c3-839b-31711dcc76ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:10.699948 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79f44bd3-38be-45c3-839b-31711dcc76ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:10.700733 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79f44bd3-38be-45c3-839b-31711dcc76ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:10.701444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79f44bd3-38be-45c3-839b-31711dcc76ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:10.702302 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79f44bd3-38be-45c3-839b-31711dcc76ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:10.703449 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79f44bd3-38be-45c3-839b-31711dcc76ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:10.704097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-79f44bd3-38be-45c3-839b-31711dcc76ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:10.871659 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-79f44bd3-38be-45c3-839b-31711dcc76ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:10.879726 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-79f44bd3-38be-45c3-839b-31711dcc76ac tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1265 microversion: 2.1 time: 0.198160 Sep 06 04:46:10.880307 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 554/1126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:10 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:11.575473 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4ce57ac5-2702-4fca-86c1-70a966e38e4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:11.576198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4ce57ac5-2702-4fca-86c1-70a966e38e4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:11.604208 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ce57ac5-2702-4fca-86c1-70a966e38e4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:11.605036 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ce57ac5-2702-4fca-86c1-70a966e38e4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:11.605731 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ce57ac5-2702-4fca-86c1-70a966e38e4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:11.606650 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ce57ac5-2702-4fca-86c1-70a966e38e4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:11.607275 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ce57ac5-2702-4fca-86c1-70a966e38e4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:11.610242 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4ce57ac5-2702-4fca-86c1-70a966e38e4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:11.890075 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4ce57ac5-2702-4fca-86c1-70a966e38e4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:11.903584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6ff15a75-db39-49b5-839f-1e942041994e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:11.904257 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6ff15a75-db39-49b5-839f-1e942041994e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:11.917982 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ff15a75-db39-49b5-839f-1e942041994e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:11.918468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ff15a75-db39-49b5-839f-1e942041994e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:11.920484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ff15a75-db39-49b5-839f-1e942041994e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:11.921400 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ff15a75-db39-49b5-839f-1e942041994e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:11.924005 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ff15a75-db39-49b5-839f-1e942041994e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:11.924171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4ce57ac5-2702-4fca-86c1-70a966e38e4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:11.927765 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6ff15a75-db39-49b5-839f-1e942041994e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:11.932509 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4ce57ac5-2702-4fca-86c1-70a966e38e4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:11.934220 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4ce57ac5-2702-4fca-86c1-70a966e38e4c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1723 microversion: 2.20 time: 0.370337 Sep 06 04:46:11.934825 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 573/1127] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:11 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1723 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:12.351907 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6ff15a75-db39-49b5-839f-1e942041994e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:12.371813 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6ff15a75-db39-49b5-839f-1e942041994e tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1452 microversion: 2.1 time: 0.472039 Sep 06 04:46:12.372403 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 555/1128] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:11 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1452 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:12.400136 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0389416a-d9d0-4df1-86e8-a0f70cc88561 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:12.401053 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0389416a-d9d0-4df1-86e8-a0f70cc88561 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:12.415685 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0389416a-d9d0-4df1-86e8-a0f70cc88561 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:12.416248 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0389416a-d9d0-4df1-86e8-a0f70cc88561 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:12.416698 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0389416a-d9d0-4df1-86e8-a0f70cc88561 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:12.417619 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0389416a-d9d0-4df1-86e8-a0f70cc88561 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:12.418211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0389416a-d9d0-4df1-86e8-a0f70cc88561 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:12.418847 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0389416a-d9d0-4df1-86e8-a0f70cc88561 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:12.799368 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0389416a-d9d0-4df1-86e8-a0f70cc88561 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:12.808671 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0389416a-d9d0-4df1-86e8-a0f70cc88561 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1452 microversion: 2.1 time: 0.413294 Sep 06 04:46:12.810964 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 574/1129] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:46:12 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1452 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:46:12.964151 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-66b9f37c-fc15-4076-b2fe-eb5f0b1d9668 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:12.967244 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-66b9f37c-fc15-4076-b2fe-eb5f0b1d9668 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:12.978065 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66b9f37c-fc15-4076-b2fe-eb5f0b1d9668 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:12.979307 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66b9f37c-fc15-4076-b2fe-eb5f0b1d9668 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:12.979973 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66b9f37c-fc15-4076-b2fe-eb5f0b1d9668 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:12.984582 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66b9f37c-fc15-4076-b2fe-eb5f0b1d9668 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:12.984582 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66b9f37c-fc15-4076-b2fe-eb5f0b1d9668 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:12.984582 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-66b9f37c-fc15-4076-b2fe-eb5f0b1d9668 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:13.260148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-66b9f37c-fc15-4076-b2fe-eb5f0b1d9668 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:13.274391 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-66b9f37c-fc15-4076-b2fe-eb5f0b1d9668 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:13.276457 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-66b9f37c-fc15-4076-b2fe-eb5f0b1d9668 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:13.283926 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-66b9f37c-fc15-4076-b2fe-eb5f0b1d9668 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1723 microversion: 2.20 time: 0.325141 Sep 06 04:46:13.301538 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 556/1130] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:12 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1723 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:14.311698 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ebadf8b0-3945-47eb-87d4-9a7c302f22be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:14.313719 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ebadf8b0-3945-47eb-87d4-9a7c302f22be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:14.322784 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebadf8b0-3945-47eb-87d4-9a7c302f22be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:14.326031 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebadf8b0-3945-47eb-87d4-9a7c302f22be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:14.326817 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebadf8b0-3945-47eb-87d4-9a7c302f22be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:14.331412 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebadf8b0-3945-47eb-87d4-9a7c302f22be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:14.332119 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebadf8b0-3945-47eb-87d4-9a7c302f22be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:14.332556 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ebadf8b0-3945-47eb-87d4-9a7c302f22be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:14.732722 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ebadf8b0-3945-47eb-87d4-9a7c302f22be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:14.752548 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ebadf8b0-3945-47eb-87d4-9a7c302f22be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:14.755585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ebadf8b0-3945-47eb-87d4-9a7c302f22be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:14.757006 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ebadf8b0-3945-47eb-87d4-9a7c302f22be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1723 microversion: 2.20 time: 0.449492 Sep 06 04:46:14.773605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 575/1131] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:14 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1723 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:14.886137 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-43154c85-ee16-4cdd-a786-fbbb9d1dd0a3 req-56caf09e-1542-48f1-9a01-53cadba26aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821737e4-9236-4f80-b1ac-8c4d16c02244", "name": "network-vif-unplugged", "status": "completed", "tag": "3e4ec09b-2a4b-41e0-871c-50fd282365c6"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:46:14.901649 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-43154c85-ee16-4cdd-a786-fbbb9d1dd0a3 req-56caf09e-1542-48f1-9a01-53cadba26aa4 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:14.905849 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-43154c85-ee16-4cdd-a786-fbbb9d1dd0a3 req-56caf09e-1542-48f1-9a01-53cadba26aa4 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:14.906518 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-43154c85-ee16-4cdd-a786-fbbb9d1dd0a3 req-56caf09e-1542-48f1-9a01-53cadba26aa4 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:14.928838 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-43154c85-ee16-4cdd-a786-fbbb9d1dd0a3 req-56caf09e-1542-48f1-9a01-53cadba26aa4 service nova] Creating event network-vif-unplugged:3e4ec09b-2a4b-41e0-871c-50fd282365c6 for instance 821737e4-9236-4f80-b1ac-8c4d16c02244 on hv-cinder-85600 Sep 06 04:46:14.934485 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-43154c85-ee16-4cdd-a786-fbbb9d1dd0a3 req-56caf09e-1542-48f1-9a01-53cadba26aa4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053360 Sep 06 04:46:14.935210 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 557/1132] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:46:15.794793 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0416731c-e619-4c63-b1e4-08c29e76afbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:15.795948 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0416731c-e619-4c63-b1e4-08c29e76afbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:15.828892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0416731c-e619-4c63-b1e4-08c29e76afbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:15.832082 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0416731c-e619-4c63-b1e4-08c29e76afbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:15.833115 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0416731c-e619-4c63-b1e4-08c29e76afbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:15.840385 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0416731c-e619-4c63-b1e4-08c29e76afbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:15.841211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0416731c-e619-4c63-b1e4-08c29e76afbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:15.841911 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0416731c-e619-4c63-b1e4-08c29e76afbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:16.269253 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0416731c-e619-4c63-b1e4-08c29e76afbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:16.297920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0416731c-e619-4c63-b1e4-08c29e76afbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:16.300638 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0416731c-e619-4c63-b1e4-08c29e76afbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:16.302108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0416731c-e619-4c63-b1e4-08c29e76afbf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1726 microversion: 2.20 time: 0.518652 Sep 06 04:46:16.303155 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 576/1133] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:15 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1726 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:16.332130 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-93950422-5ffd-4878-ad54-ac81b0d9108c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37d208c1-86d9-4d73-9801-3b2e8e530a1f"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:46:16.335694 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-93950422-5ffd-4878-ad54-ac81b0d9108c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:16.342840 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93950422-5ffd-4878-ad54-ac81b0d9108c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:16.346491 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93950422-5ffd-4878-ad54-ac81b0d9108c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:16.346491 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93950422-5ffd-4878-ad54-ac81b0d9108c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:16.346491 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93950422-5ffd-4878-ad54-ac81b0d9108c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:16.346491 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93950422-5ffd-4878-ad54-ac81b0d9108c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:16.346881 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-93950422-5ffd-4878-ad54-ac81b0d9108c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:17.319650 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-8206b850-52be-4e60-aae0-f87180bd7109 req-4eed0bbe-f7c7-48a2-8e39-86540f29bcd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17758d6d-93d6-48b1-890f-eca1a0fe0058", "tag": "0f636c18-fb41-4c1e-b52b-868f0f44b336"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:46:17.341505 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:46:17.344407 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8206b850-52be-4e60-aae0-f87180bd7109 req-4eed0bbe-f7c7-48a2-8e39-86540f29bcd7 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:17.348055 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8206b850-52be-4e60-aae0-f87180bd7109 req-4eed0bbe-f7c7-48a2-8e39-86540f29bcd7 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:17.351872 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-8206b850-52be-4e60-aae0-f87180bd7109 req-4eed0bbe-f7c7-48a2-8e39-86540f29bcd7 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:17.390253 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-8206b850-52be-4e60-aae0-f87180bd7109 req-4eed0bbe-f7c7-48a2-8e39-86540f29bcd7 service nova] Creating event network-changed:0f636c18-fb41-4c1e-b52b-868f0f44b336 for instance 17758d6d-93d6-48b1-890f-eca1a0fe0058 on hv-cinder-85600 Sep 06 04:46:17.401224 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-8206b850-52be-4e60-aae0-f87180bd7109 req-4eed0bbe-f7c7-48a2-8e39-86540f29bcd7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090311 Sep 06 04:46:17.402159 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 577/1134] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:46:17.508138 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-93950422-5ffd-4878-ad54-ac81b0d9108c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "POST /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.183879 Sep 06 04:46:17.515415 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 558/1135] 10.222.0.30 () {62 vars in 1364 bytes} [Tue Sep 6 04:46:16 2022] POST /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244/os-volume_attachments => generated 188 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 06 04:46:17.794195 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9228adfc-3263-4ffb-8608-5a54362be73c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:17.796397 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9228adfc-3263-4ffb-8608-5a54362be73c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:17.815429 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9228adfc-3263-4ffb-8608-5a54362be73c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:17.819498 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9228adfc-3263-4ffb-8608-5a54362be73c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:17.819498 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9228adfc-3263-4ffb-8608-5a54362be73c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:17.819498 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9228adfc-3263-4ffb-8608-5a54362be73c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:17.819498 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9228adfc-3263-4ffb-8608-5a54362be73c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:17.819859 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9228adfc-3263-4ffb-8608-5a54362be73c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:18.186835 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:46:18.817500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9228adfc-3263-4ffb-8608-5a54362be73c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "DELETE /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244/os-volume_attachments/37d208c1-86d9-4d73-9801-3b2e8e530a1f" status: 202 len: 0 microversion: 2.20 time: 1.029203 Sep 06 04:46:18.819500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 578/1136] 10.222.0.30 () {60 vars in 1457 bytes} [Tue Sep 6 04:46:17 2022] DELETE /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244/os-volume_attachments/37d208c1-86d9-4d73-9801-3b2e8e530a1f => generated 0 bytes in 1031 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:46:18.970207 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2a877dac-64d9-47b2-98c2-676175a376b7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:46:18.970816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2a877dac-64d9-47b2-98c2-676175a376b7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:18.979199 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:46:18.991051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a877dac-64d9-47b2-98c2-676175a376b7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:18.991533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a877dac-64d9-47b2-98c2-676175a376b7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:18.992003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a877dac-64d9-47b2-98c2-676175a376b7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:18.992710 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a877dac-64d9-47b2-98c2-676175a376b7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:18.993168 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a877dac-64d9-47b2-98c2-676175a376b7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:18.995909 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2a877dac-64d9-47b2-98c2-676175a376b7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:19.041071 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2a877dac-64d9-47b2-98c2-676175a376b7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127617) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 06 04:46:19.322074 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2a877dac-64d9-47b2-98c2-676175a376b7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "POST /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244/action" status: 202 len: 0 microversion: 2.20 time: 0.343336 Sep 06 04:46:19.323161 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 559/1137] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Sep 6 04:46:18 2022] POST /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:46:19.331654 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1f159fab-4181-4a3c-953d-41d8f0246a6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:19.332556 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1f159fab-4181-4a3c-953d-41d8f0246a6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:19.342114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f159fab-4181-4a3c-953d-41d8f0246a6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:19.342114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f159fab-4181-4a3c-953d-41d8f0246a6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:19.345566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f159fab-4181-4a3c-953d-41d8f0246a6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:19.346292 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f159fab-4181-4a3c-953d-41d8f0246a6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:19.346752 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f159fab-4181-4a3c-953d-41d8f0246a6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:19.347176 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1f159fab-4181-4a3c-953d-41d8f0246a6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:19.589410 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1f159fab-4181-4a3c-953d-41d8f0246a6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:19.607232 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1f159fab-4181-4a3c-953d-41d8f0246a6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:19.610607 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1f159fab-4181-4a3c-953d-41d8f0246a6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:19.614257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1f159fab-4181-4a3c-953d-41d8f0246a6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1674 microversion: 2.20 time: 0.287092 Sep 06 04:46:19.622153 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 579/1138] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:19 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1674 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:20.651332 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4eaad8c5-0ae5-4ebb-821e-6fb3bb8e42df tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:20.651943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4eaad8c5-0ae5-4ebb-821e-6fb3bb8e42df tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:20.661225 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4eaad8c5-0ae5-4ebb-821e-6fb3bb8e42df tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:20.661750 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4eaad8c5-0ae5-4ebb-821e-6fb3bb8e42df tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:20.662188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4eaad8c5-0ae5-4ebb-821e-6fb3bb8e42df tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:20.662892 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4eaad8c5-0ae5-4ebb-821e-6fb3bb8e42df tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:20.663344 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4eaad8c5-0ae5-4ebb-821e-6fb3bb8e42df tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:20.663767 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4eaad8c5-0ae5-4ebb-821e-6fb3bb8e42df tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:20.911693 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4eaad8c5-0ae5-4ebb-821e-6fb3bb8e42df tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:20.922781 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4eaad8c5-0ae5-4ebb-821e-6fb3bb8e42df tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:20.924535 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4eaad8c5-0ae5-4ebb-821e-6fb3bb8e42df tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:20.925966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4eaad8c5-0ae5-4ebb-821e-6fb3bb8e42df tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1674 microversion: 2.20 time: 0.278633 Sep 06 04:46:20.945547 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 560/1139] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:20 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1674 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:21.956975 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-efef694b-b9ec-4754-b731-88c5ba3bb6e0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:21.957659 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-efef694b-b9ec-4754-b731-88c5ba3bb6e0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:21.965127 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efef694b-b9ec-4754-b731-88c5ba3bb6e0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:21.971380 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efef694b-b9ec-4754-b731-88c5ba3bb6e0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:21.971879 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efef694b-b9ec-4754-b731-88c5ba3bb6e0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:21.972780 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efef694b-b9ec-4754-b731-88c5ba3bb6e0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:21.973389 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efef694b-b9ec-4754-b731-88c5ba3bb6e0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:21.974207 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-efef694b-b9ec-4754-b731-88c5ba3bb6e0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:22.156909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-efef694b-b9ec-4754-b731-88c5ba3bb6e0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:22.181849 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-efef694b-b9ec-4754-b731-88c5ba3bb6e0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:22.184359 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-efef694b-b9ec-4754-b731-88c5ba3bb6e0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:22.186215 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-efef694b-b9ec-4754-b731-88c5ba3bb6e0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1676 microversion: 2.20 time: 0.235801 Sep 06 04:46:22.230976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 580/1140] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:21 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1676 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 06 04:46:23.252809 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eef40f48-8e98-4c7f-bfee-ff89d353698b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:23.260720 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-eef40f48-8e98-4c7f-bfee-ff89d353698b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:23.273799 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eef40f48-8e98-4c7f-bfee-ff89d353698b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:23.274653 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eef40f48-8e98-4c7f-bfee-ff89d353698b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:23.275730 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eef40f48-8e98-4c7f-bfee-ff89d353698b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:23.276841 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eef40f48-8e98-4c7f-bfee-ff89d353698b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:23.277658 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eef40f48-8e98-4c7f-bfee-ff89d353698b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:23.278396 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eef40f48-8e98-4c7f-bfee-ff89d353698b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:23.475002 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eef40f48-8e98-4c7f-bfee-ff89d353698b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:23.488144 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eef40f48-8e98-4c7f-bfee-ff89d353698b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:23.490239 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-eef40f48-8e98-4c7f-bfee-ff89d353698b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:23.491718 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-eef40f48-8e98-4c7f-bfee-ff89d353698b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.248727 Sep 06 04:46:23.492473 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 561/1141] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:23 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:24.523153 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1e66209a-f68f-42e4-a8ab-63b4d41ce14e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:24.524642 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1e66209a-f68f-42e4-a8ab-63b4d41ce14e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:24.533333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e66209a-f68f-42e4-a8ab-63b4d41ce14e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:24.534191 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e66209a-f68f-42e4-a8ab-63b4d41ce14e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:24.534871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e66209a-f68f-42e4-a8ab-63b4d41ce14e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:24.535815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e66209a-f68f-42e4-a8ab-63b4d41ce14e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:24.536488 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e66209a-f68f-42e4-a8ab-63b4d41ce14e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:24.537130 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e66209a-f68f-42e4-a8ab-63b4d41ce14e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:24.726975 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1e66209a-f68f-42e4-a8ab-63b4d41ce14e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:24.743632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1e66209a-f68f-42e4-a8ab-63b4d41ce14e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:24.745657 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1e66209a-f68f-42e4-a8ab-63b4d41ce14e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:24.747481 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1e66209a-f68f-42e4-a8ab-63b4d41ce14e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.228802 Sep 06 04:46:24.748805 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 581/1142] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:24 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:25.775422 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9e63e6e4-7872-461d-8ced-07f4684d82fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:25.776202 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9e63e6e4-7872-461d-8ced-07f4684d82fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:25.783951 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e63e6e4-7872-461d-8ced-07f4684d82fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:25.784808 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e63e6e4-7872-461d-8ced-07f4684d82fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:25.785564 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e63e6e4-7872-461d-8ced-07f4684d82fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:25.786526 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e63e6e4-7872-461d-8ced-07f4684d82fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:25.787197 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e63e6e4-7872-461d-8ced-07f4684d82fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:25.787842 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9e63e6e4-7872-461d-8ced-07f4684d82fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:25.987961 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9e63e6e4-7872-461d-8ced-07f4684d82fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:26.005736 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9e63e6e4-7872-461d-8ced-07f4684d82fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:26.007463 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9e63e6e4-7872-461d-8ced-07f4684d82fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:26.008843 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9e63e6e4-7872-461d-8ced-07f4684d82fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.237476 Sep 06 04:46:26.009872 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 562/1143] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:25 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:27.041691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7562c032-dea1-475f-8413-9cb24bcaaaa9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:27.049083 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7562c032-dea1-475f-8413-9cb24bcaaaa9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:27.058860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7562c032-dea1-475f-8413-9cb24bcaaaa9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:27.059802 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7562c032-dea1-475f-8413-9cb24bcaaaa9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:27.060406 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7562c032-dea1-475f-8413-9cb24bcaaaa9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:27.061478 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7562c032-dea1-475f-8413-9cb24bcaaaa9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:27.062793 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7562c032-dea1-475f-8413-9cb24bcaaaa9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:27.063381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7562c032-dea1-475f-8413-9cb24bcaaaa9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:27.474493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7562c032-dea1-475f-8413-9cb24bcaaaa9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:27.490638 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7562c032-dea1-475f-8413-9cb24bcaaaa9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:27.492254 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7562c032-dea1-475f-8413-9cb24bcaaaa9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:27.493615 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7562c032-dea1-475f-8413-9cb24bcaaaa9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.457870 Sep 06 04:46:27.495228 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 582/1144] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:27 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:28.523668 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-484af5b7-1db7-4f6b-89ab-a175d5cb76f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:28.525494 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-484af5b7-1db7-4f6b-89ab-a175d5cb76f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:28.535376 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-484af5b7-1db7-4f6b-89ab-a175d5cb76f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:28.536468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-484af5b7-1db7-4f6b-89ab-a175d5cb76f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:28.537244 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-484af5b7-1db7-4f6b-89ab-a175d5cb76f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:28.538476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-484af5b7-1db7-4f6b-89ab-a175d5cb76f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:28.539150 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-484af5b7-1db7-4f6b-89ab-a175d5cb76f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:28.539986 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-484af5b7-1db7-4f6b-89ab-a175d5cb76f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:28.785728 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-484af5b7-1db7-4f6b-89ab-a175d5cb76f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:28.803242 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-484af5b7-1db7-4f6b-89ab-a175d5cb76f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:28.804618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-484af5b7-1db7-4f6b-89ab-a175d5cb76f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:28.806230 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-484af5b7-1db7-4f6b-89ab-a175d5cb76f4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.286836 Sep 06 04:46:28.818427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 563/1145] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:28 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:29.839949 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5790cc5f-cafe-4480-b0ec-6ae19636d8c9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:29.840566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5790cc5f-cafe-4480-b0ec-6ae19636d8c9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:29.847084 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5790cc5f-cafe-4480-b0ec-6ae19636d8c9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:29.847576 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5790cc5f-cafe-4480-b0ec-6ae19636d8c9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:29.848015 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5790cc5f-cafe-4480-b0ec-6ae19636d8c9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:29.848708 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5790cc5f-cafe-4480-b0ec-6ae19636d8c9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:29.849166 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5790cc5f-cafe-4480-b0ec-6ae19636d8c9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:29.849626 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5790cc5f-cafe-4480-b0ec-6ae19636d8c9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:29.984903 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5790cc5f-cafe-4480-b0ec-6ae19636d8c9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:29.993679 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5790cc5f-cafe-4480-b0ec-6ae19636d8c9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:29.995358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5790cc5f-cafe-4480-b0ec-6ae19636d8c9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:29.996861 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5790cc5f-cafe-4480-b0ec-6ae19636d8c9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.160482 Sep 06 04:46:29.997488 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 583/1146] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:29 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:31.023464 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5f3cad7c-fb2f-487c-addd-0ba616a1134b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:31.024129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5f3cad7c-fb2f-487c-addd-0ba616a1134b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:31.031903 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f3cad7c-fb2f-487c-addd-0ba616a1134b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:31.035079 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f3cad7c-fb2f-487c-addd-0ba616a1134b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:31.035079 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f3cad7c-fb2f-487c-addd-0ba616a1134b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:31.035079 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f3cad7c-fb2f-487c-addd-0ba616a1134b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:31.035079 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f3cad7c-fb2f-487c-addd-0ba616a1134b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:31.035468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5f3cad7c-fb2f-487c-addd-0ba616a1134b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:31.181109 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5f3cad7c-fb2f-487c-addd-0ba616a1134b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:31.184996 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:46:31.191026 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5f3cad7c-fb2f-487c-addd-0ba616a1134b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:31.192478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5f3cad7c-fb2f-487c-addd-0ba616a1134b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:31.195675 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5f3cad7c-fb2f-487c-addd-0ba616a1134b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.174269 Sep 06 04:46:31.195675 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 564/1147] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:31 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:32.220317 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-69afd00c-a6cf-4b12-890b-28bd0f6fce6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:32.220904 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-69afd00c-a6cf-4b12-890b-28bd0f6fce6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:32.228054 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69afd00c-a6cf-4b12-890b-28bd0f6fce6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:32.228653 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69afd00c-a6cf-4b12-890b-28bd0f6fce6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:32.229431 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69afd00c-a6cf-4b12-890b-28bd0f6fce6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:32.230119 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69afd00c-a6cf-4b12-890b-28bd0f6fce6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:32.230574 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69afd00c-a6cf-4b12-890b-28bd0f6fce6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:32.230997 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69afd00c-a6cf-4b12-890b-28bd0f6fce6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:32.377442 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-69afd00c-a6cf-4b12-890b-28bd0f6fce6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:32.387552 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-69afd00c-a6cf-4b12-890b-28bd0f6fce6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:32.389405 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-69afd00c-a6cf-4b12-890b-28bd0f6fce6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:32.391751 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-69afd00c-a6cf-4b12-890b-28bd0f6fce6b tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.176159 Sep 06 04:46:32.392659 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 584/1148] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:32 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:33.423861 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dca1040f-ee64-4c36-85b3-051ec5545a7e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:33.425520 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dca1040f-ee64-4c36-85b3-051ec5545a7e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:33.440678 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dca1040f-ee64-4c36-85b3-051ec5545a7e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:33.446864 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dca1040f-ee64-4c36-85b3-051ec5545a7e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:33.447439 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dca1040f-ee64-4c36-85b3-051ec5545a7e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:33.448417 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dca1040f-ee64-4c36-85b3-051ec5545a7e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:33.449013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dca1040f-ee64-4c36-85b3-051ec5545a7e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:33.449536 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dca1040f-ee64-4c36-85b3-051ec5545a7e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:33.614110 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dca1040f-ee64-4c36-85b3-051ec5545a7e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:33.629107 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dca1040f-ee64-4c36-85b3-051ec5545a7e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:33.631386 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dca1040f-ee64-4c36-85b3-051ec5545a7e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:33.632637 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dca1040f-ee64-4c36-85b3-051ec5545a7e tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.213744 Sep 06 04:46:33.633403 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 565/1149] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:33 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:34.661222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-7197f454-c64e-4ba9-8f58-2a5a77a73399 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:34.661947 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-7197f454-c64e-4ba9-8f58-2a5a77a73399 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:34.668553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7197f454-c64e-4ba9-8f58-2a5a77a73399 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:34.669125 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7197f454-c64e-4ba9-8f58-2a5a77a73399 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:34.669940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7197f454-c64e-4ba9-8f58-2a5a77a73399 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:34.670651 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7197f454-c64e-4ba9-8f58-2a5a77a73399 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:34.671317 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7197f454-c64e-4ba9-8f58-2a5a77a73399 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:34.672200 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-7197f454-c64e-4ba9-8f58-2a5a77a73399 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:34.903709 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7197f454-c64e-4ba9-8f58-2a5a77a73399 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:34.913772 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7197f454-c64e-4ba9-8f58-2a5a77a73399 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:34.915168 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-7197f454-c64e-4ba9-8f58-2a5a77a73399 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:34.916366 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-7197f454-c64e-4ba9-8f58-2a5a77a73399 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.259938 Sep 06 04:46:34.917232 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 585/1150] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:34 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:35.942304 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2f2a4360-d22d-43ca-b81c-4706148514f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:35.942978 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2f2a4360-d22d-43ca-b81c-4706148514f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:35.951132 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f2a4360-d22d-43ca-b81c-4706148514f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:35.951132 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f2a4360-d22d-43ca-b81c-4706148514f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:35.951132 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f2a4360-d22d-43ca-b81c-4706148514f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:35.951614 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f2a4360-d22d-43ca-b81c-4706148514f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:35.952069 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f2a4360-d22d-43ca-b81c-4706148514f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:35.952690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f2a4360-d22d-43ca-b81c-4706148514f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:36.089766 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2f2a4360-d22d-43ca-b81c-4706148514f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:36.099184 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2f2a4360-d22d-43ca-b81c-4706148514f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:36.101483 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2f2a4360-d22d-43ca-b81c-4706148514f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:36.102946 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2f2a4360-d22d-43ca-b81c-4706148514f8 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.165475 Sep 06 04:46:36.104048 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 566/1151] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:35 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:37.134463 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0ffa2ce1-8099-46b7-82f5-95e4111e6180 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:37.134463 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0ffa2ce1-8099-46b7-82f5-95e4111e6180 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:37.139646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ffa2ce1-8099-46b7-82f5-95e4111e6180 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:37.140134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ffa2ce1-8099-46b7-82f5-95e4111e6180 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:37.140569 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ffa2ce1-8099-46b7-82f5-95e4111e6180 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:37.141591 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ffa2ce1-8099-46b7-82f5-95e4111e6180 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:37.142047 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ffa2ce1-8099-46b7-82f5-95e4111e6180 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:37.142465 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0ffa2ce1-8099-46b7-82f5-95e4111e6180 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:37.291388 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0ffa2ce1-8099-46b7-82f5-95e4111e6180 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:37.299659 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0ffa2ce1-8099-46b7-82f5-95e4111e6180 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:37.301715 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-0ffa2ce1-8099-46b7-82f5-95e4111e6180 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:37.303376 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0ffa2ce1-8099-46b7-82f5-95e4111e6180 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.176793 Sep 06 04:46:37.304402 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 586/1152] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:37 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:38.330583 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6df0a7c2-6508-4795-b1f8-44888febe7de tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:38.331235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6df0a7c2-6508-4795-b1f8-44888febe7de tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:38.337488 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df0a7c2-6508-4795-b1f8-44888febe7de tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:38.337976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df0a7c2-6508-4795-b1f8-44888febe7de tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:38.338480 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df0a7c2-6508-4795-b1f8-44888febe7de tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:38.339092 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df0a7c2-6508-4795-b1f8-44888febe7de tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:38.339687 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df0a7c2-6508-4795-b1f8-44888febe7de tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:38.340108 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df0a7c2-6508-4795-b1f8-44888febe7de tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:38.477032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6df0a7c2-6508-4795-b1f8-44888febe7de tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:38.485737 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6df0a7c2-6508-4795-b1f8-44888febe7de tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:38.487104 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6df0a7c2-6508-4795-b1f8-44888febe7de tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:38.488255 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6df0a7c2-6508-4795-b1f8-44888febe7de tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.162792 Sep 06 04:46:38.488808 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 567/1153] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:38 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:39.513918 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3c00338a-e886-4410-b689-6dacb72d9639 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:39.514469 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3c00338a-e886-4410-b689-6dacb72d9639 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:39.521474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c00338a-e886-4410-b689-6dacb72d9639 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:39.521975 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c00338a-e886-4410-b689-6dacb72d9639 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:39.522405 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c00338a-e886-4410-b689-6dacb72d9639 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:39.523108 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c00338a-e886-4410-b689-6dacb72d9639 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:39.523559 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c00338a-e886-4410-b689-6dacb72d9639 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:39.523979 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3c00338a-e886-4410-b689-6dacb72d9639 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:39.656359 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3c00338a-e886-4410-b689-6dacb72d9639 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:39.665402 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3c00338a-e886-4410-b689-6dacb72d9639 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:39.667486 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3c00338a-e886-4410-b689-6dacb72d9639 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:39.668066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3c00338a-e886-4410-b689-6dacb72d9639 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.158522 Sep 06 04:46:39.668626 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 587/1154] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:39 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:40.695179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-42a757ff-5509-4319-8a2f-e127b556eacf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:40.695841 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-42a757ff-5509-4319-8a2f-e127b556eacf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:40.702170 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42a757ff-5509-4319-8a2f-e127b556eacf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:40.702687 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42a757ff-5509-4319-8a2f-e127b556eacf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:40.703116 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42a757ff-5509-4319-8a2f-e127b556eacf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:40.704324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42a757ff-5509-4319-8a2f-e127b556eacf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:40.704772 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42a757ff-5509-4319-8a2f-e127b556eacf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:40.705192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42a757ff-5509-4319-8a2f-e127b556eacf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:40.841998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-42a757ff-5509-4319-8a2f-e127b556eacf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:40.851317 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-42a757ff-5509-4319-8a2f-e127b556eacf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:40.852752 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-42a757ff-5509-4319-8a2f-e127b556eacf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:40.853940 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-42a757ff-5509-4319-8a2f-e127b556eacf tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.163509 Sep 06 04:46:40.854506 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 568/1155] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:40 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:41.878569 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3f17779d-8ca1-4d5b-9162-084dd24ac650 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:41.879194 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3f17779d-8ca1-4d5b-9162-084dd24ac650 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:41.885550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f17779d-8ca1-4d5b-9162-084dd24ac650 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:41.886123 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f17779d-8ca1-4d5b-9162-084dd24ac650 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:41.886633 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f17779d-8ca1-4d5b-9162-084dd24ac650 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:41.887917 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f17779d-8ca1-4d5b-9162-084dd24ac650 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:41.888551 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f17779d-8ca1-4d5b-9162-084dd24ac650 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:41.889134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3f17779d-8ca1-4d5b-9162-084dd24ac650 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:42.020339 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3f17779d-8ca1-4d5b-9162-084dd24ac650 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:42.028308 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3f17779d-8ca1-4d5b-9162-084dd24ac650 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:42.030040 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3f17779d-8ca1-4d5b-9162-084dd24ac650 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:42.031192 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3f17779d-8ca1-4d5b-9162-084dd24ac650 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.156742 Sep 06 04:46:42.031788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 588/1156] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:41 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:43.058089 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f0fefcb1-04e9-4261-bbf7-ccc228387a14 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:43.058715 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f0fefcb1-04e9-4261-bbf7-ccc228387a14 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:43.065865 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0fefcb1-04e9-4261-bbf7-ccc228387a14 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:43.066347 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0fefcb1-04e9-4261-bbf7-ccc228387a14 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:43.066790 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0fefcb1-04e9-4261-bbf7-ccc228387a14 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:43.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0fefcb1-04e9-4261-bbf7-ccc228387a14 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:43.067936 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0fefcb1-04e9-4261-bbf7-ccc228387a14 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:43.068361 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f0fefcb1-04e9-4261-bbf7-ccc228387a14 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:43.200695 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f0fefcb1-04e9-4261-bbf7-ccc228387a14 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:43.209493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f0fefcb1-04e9-4261-bbf7-ccc228387a14 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:43.211044 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f0fefcb1-04e9-4261-bbf7-ccc228387a14 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:43.212277 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f0fefcb1-04e9-4261-bbf7-ccc228387a14 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.158424 Sep 06 04:46:43.212916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 569/1157] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:43 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:44.239372 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-167e05d3-de9d-47de-a3b0-29d7a03ef33f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:44.240276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-167e05d3-de9d-47de-a3b0-29d7a03ef33f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:44.247650 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-167e05d3-de9d-47de-a3b0-29d7a03ef33f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:44.248139 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-167e05d3-de9d-47de-a3b0-29d7a03ef33f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:44.248574 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-167e05d3-de9d-47de-a3b0-29d7a03ef33f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:44.249275 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-167e05d3-de9d-47de-a3b0-29d7a03ef33f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:44.249768 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-167e05d3-de9d-47de-a3b0-29d7a03ef33f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:44.250195 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-167e05d3-de9d-47de-a3b0-29d7a03ef33f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:44.382516 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-167e05d3-de9d-47de-a3b0-29d7a03ef33f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:44.390808 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-167e05d3-de9d-47de-a3b0-29d7a03ef33f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:44.392268 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-167e05d3-de9d-47de-a3b0-29d7a03ef33f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:44.393554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-167e05d3-de9d-47de-a3b0-29d7a03ef33f tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.158989 Sep 06 04:46:44.394121 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 589/1158] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:44 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:45.420118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5bb59061-a116-44d1-a2dd-5860b8aaeefc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:45.420728 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5bb59061-a116-44d1-a2dd-5860b8aaeefc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:45.427769 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bb59061-a116-44d1-a2dd-5860b8aaeefc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:45.428250 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bb59061-a116-44d1-a2dd-5860b8aaeefc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:45.428682 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bb59061-a116-44d1-a2dd-5860b8aaeefc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:45.429388 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bb59061-a116-44d1-a2dd-5860b8aaeefc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:45.429838 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bb59061-a116-44d1-a2dd-5860b8aaeefc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:45.430258 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5bb59061-a116-44d1-a2dd-5860b8aaeefc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:45.566709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5bb59061-a116-44d1-a2dd-5860b8aaeefc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:45.574679 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5bb59061-a116-44d1-a2dd-5860b8aaeefc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:45.576777 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5bb59061-a116-44d1-a2dd-5860b8aaeefc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:45.578155 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5bb59061-a116-44d1-a2dd-5860b8aaeefc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.162042 Sep 06 04:46:45.578830 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 570/1159] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:45 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:46.605841 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1d9cbff6-c410-4fc2-86e3-323f092a802c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:46.606471 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1d9cbff6-c410-4fc2-86e3-323f092a802c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:46.612896 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1d9cbff6-c410-4fc2-86e3-323f092a802c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:46.613405 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1d9cbff6-c410-4fc2-86e3-323f092a802c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:46.613839 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1d9cbff6-c410-4fc2-86e3-323f092a802c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:46.614523 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1d9cbff6-c410-4fc2-86e3-323f092a802c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:46.614968 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1d9cbff6-c410-4fc2-86e3-323f092a802c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:46.615389 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1d9cbff6-c410-4fc2-86e3-323f092a802c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:46.756612 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1d9cbff6-c410-4fc2-86e3-323f092a802c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:46.765840 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1d9cbff6-c410-4fc2-86e3-323f092a802c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:46.767317 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1d9cbff6-c410-4fc2-86e3-323f092a802c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:46.768990 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1d9cbff6-c410-4fc2-86e3-323f092a802c tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.167028 Sep 06 04:46:46.769599 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 590/1160] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:46 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:47.796023 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1aff96a7-8965-4b23-bb03-d2274e37cbeb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:47.796766 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1aff96a7-8965-4b23-bb03-d2274e37cbeb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:47.803823 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1aff96a7-8965-4b23-bb03-d2274e37cbeb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:47.804511 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1aff96a7-8965-4b23-bb03-d2274e37cbeb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:47.805055 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1aff96a7-8965-4b23-bb03-d2274e37cbeb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:47.806452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1aff96a7-8965-4b23-bb03-d2274e37cbeb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:47.806645 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1aff96a7-8965-4b23-bb03-d2274e37cbeb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:47.807157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1aff96a7-8965-4b23-bb03-d2274e37cbeb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:47.936762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1aff96a7-8965-4b23-bb03-d2274e37cbeb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:47.945472 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1aff96a7-8965-4b23-bb03-d2274e37cbeb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:47.946884 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1aff96a7-8965-4b23-bb03-d2274e37cbeb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:47.948031 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1aff96a7-8965-4b23-bb03-d2274e37cbeb tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.155931 Sep 06 04:46:47.948587 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 571/1161] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:47 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:48.976842 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-465ae648-d660-4ddf-b09f-40ca33e651a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:48.977503 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-465ae648-d660-4ddf-b09f-40ca33e651a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:48.980161 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=28 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:46:48.984892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-465ae648-d660-4ddf-b09f-40ca33e651a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:48.985359 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-465ae648-d660-4ddf-b09f-40ca33e651a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:48.985790 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-465ae648-d660-4ddf-b09f-40ca33e651a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:48.986475 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-465ae648-d660-4ddf-b09f-40ca33e651a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:48.986921 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-465ae648-d660-4ddf-b09f-40ca33e651a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:48.987338 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-465ae648-d660-4ddf-b09f-40ca33e651a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:48.993421 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=77,nova_cell1:UPDATE=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:46:49.121235 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-465ae648-d660-4ddf-b09f-40ca33e651a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:49.130145 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-465ae648-d660-4ddf-b09f-40ca33e651a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:49.134288 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-465ae648-d660-4ddf-b09f-40ca33e651a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:49.134288 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-465ae648-d660-4ddf-b09f-40ca33e651a7 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.160656 Sep 06 04:46:49.134288 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 591/1162] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:48 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:50.158601 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-96c9435d-9bb2-497c-94d0-016649d5d686 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:50.159192 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-96c9435d-9bb2-497c-94d0-016649d5d686 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:50.162272 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:46:50.166969 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96c9435d-9bb2-497c-94d0-016649d5d686 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:50.167389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96c9435d-9bb2-497c-94d0-016649d5d686 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:50.167813 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96c9435d-9bb2-497c-94d0-016649d5d686 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:50.168490 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96c9435d-9bb2-497c-94d0-016649d5d686 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:50.168933 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96c9435d-9bb2-497c-94d0-016649d5d686 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:50.169375 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-96c9435d-9bb2-497c-94d0-016649d5d686 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:50.301574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-96c9435d-9bb2-497c-94d0-016649d5d686 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:50.309716 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-96c9435d-9bb2-497c-94d0-016649d5d686 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:50.311317 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-96c9435d-9bb2-497c-94d0-016649d5d686 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:50.312480 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-96c9435d-9bb2-497c-94d0-016649d5d686 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.158019 Sep 06 04:46:50.313033 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 572/1163] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:50 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:51.104122 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-23918ffd-b2c8-4da6-98ba-57f83bec707a req-11627128-ff02-45c1-b454-ac6fac9a671e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821737e4-9236-4f80-b1ac-8c4d16c02244", "name": "network-vif-plugged", "status": "completed", "tag": "3e4ec09b-2a4b-41e0-871c-50fd282365c6"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:46:51.114495 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-23918ffd-b2c8-4da6-98ba-57f83bec707a req-11627128-ff02-45c1-b454-ac6fac9a671e service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:51.114970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-23918ffd-b2c8-4da6-98ba-57f83bec707a req-11627128-ff02-45c1-b454-ac6fac9a671e service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:51.115403 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-23918ffd-b2c8-4da6-98ba-57f83bec707a req-11627128-ff02-45c1-b454-ac6fac9a671e service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:51.126148 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-23918ffd-b2c8-4da6-98ba-57f83bec707a req-11627128-ff02-45c1-b454-ac6fac9a671e service nova] Creating event network-vif-plugged:3e4ec09b-2a4b-41e0-871c-50fd282365c6 for instance 821737e4-9236-4f80-b1ac-8c4d16c02244 on hv-cinder-85600 Sep 06 04:46:51.131956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-23918ffd-b2c8-4da6-98ba-57f83bec707a req-11627128-ff02-45c1-b454-ac6fac9a671e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031538 Sep 06 04:46:51.132554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 592/1164] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:46:51.338857 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-15ba3679-b17f-4580-afc4-0971f79e0688 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:51.339528 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-15ba3679-b17f-4580-afc4-0971f79e0688 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:51.345905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15ba3679-b17f-4580-afc4-0971f79e0688 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:51.346382 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15ba3679-b17f-4580-afc4-0971f79e0688 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:51.346807 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15ba3679-b17f-4580-afc4-0971f79e0688 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:51.347489 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15ba3679-b17f-4580-afc4-0971f79e0688 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:51.348035 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15ba3679-b17f-4580-afc4-0971f79e0688 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:51.348935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-15ba3679-b17f-4580-afc4-0971f79e0688 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:51.479434 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-15ba3679-b17f-4580-afc4-0971f79e0688 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:51.487671 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-15ba3679-b17f-4580-afc4-0971f79e0688 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:51.489681 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-15ba3679-b17f-4580-afc4-0971f79e0688 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:51.490835 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-15ba3679-b17f-4580-afc4-0971f79e0688 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.156877 Sep 06 04:46:51.491389 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 573/1165] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:51 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:52.516339 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-223a4ea1-03d5-490f-a524-a602a9b8e4be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:52.517055 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-223a4ea1-03d5-490f-a524-a602a9b8e4be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:52.524001 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-223a4ea1-03d5-490f-a524-a602a9b8e4be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:52.524479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-223a4ea1-03d5-490f-a524-a602a9b8e4be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:52.524920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-223a4ea1-03d5-490f-a524-a602a9b8e4be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:52.525627 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-223a4ea1-03d5-490f-a524-a602a9b8e4be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:52.526081 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-223a4ea1-03d5-490f-a524-a602a9b8e4be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:52.527586 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-223a4ea1-03d5-490f-a524-a602a9b8e4be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:52.654353 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-223a4ea1-03d5-490f-a524-a602a9b8e4be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:52.663165 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-223a4ea1-03d5-490f-a524-a602a9b8e4be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:52.664638 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-223a4ea1-03d5-490f-a524-a602a9b8e4be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:52.665823 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-223a4ea1-03d5-490f-a524-a602a9b8e4be tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.154224 Sep 06 04:46:52.670653 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 593/1166] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:52 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:53.695113 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a0961817-73ae-4161-93ea-7e2f43041523 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:53.695726 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a0961817-73ae-4161-93ea-7e2f43041523 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:53.702273 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0961817-73ae-4161-93ea-7e2f43041523 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:53.702755 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0961817-73ae-4161-93ea-7e2f43041523 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:53.703197 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0961817-73ae-4161-93ea-7e2f43041523 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:53.704068 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0961817-73ae-4161-93ea-7e2f43041523 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:53.704525 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0961817-73ae-4161-93ea-7e2f43041523 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:53.704946 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a0961817-73ae-4161-93ea-7e2f43041523 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:53.853426 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a0961817-73ae-4161-93ea-7e2f43041523 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:53.863875 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a0961817-73ae-4161-93ea-7e2f43041523 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:53.865590 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a0961817-73ae-4161-93ea-7e2f43041523 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:53.866612 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a0961817-73ae-4161-93ea-7e2f43041523 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.176095 Sep 06 04:46:53.867170 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 574/1167] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:53 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:54.892306 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-48ba9bb4-b322-48fe-8043-325081caedee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:54.892941 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-48ba9bb4-b322-48fe-8043-325081caedee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:54.900197 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48ba9bb4-b322-48fe-8043-325081caedee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:54.900666 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48ba9bb4-b322-48fe-8043-325081caedee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:54.901093 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48ba9bb4-b322-48fe-8043-325081caedee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:54.903077 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48ba9bb4-b322-48fe-8043-325081caedee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:54.903077 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48ba9bb4-b322-48fe-8043-325081caedee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:54.903077 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48ba9bb4-b322-48fe-8043-325081caedee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:55.032872 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-48ba9bb4-b322-48fe-8043-325081caedee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:55.041594 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-48ba9bb4-b322-48fe-8043-325081caedee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:55.043019 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-48ba9bb4-b322-48fe-8043-325081caedee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:55.044160 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-48ba9bb4-b322-48fe-8043-325081caedee tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1732 microversion: 2.20 time: 0.155876 Sep 06 04:46:55.044728 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 594/1168] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:54 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:46:56.070185 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-014e95f2-8796-4afa-a1d5-2f05eefad7ac tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:46:56.070793 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-014e95f2-8796-4afa-a1d5-2f05eefad7ac tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:46:56.077329 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-014e95f2-8796-4afa-a1d5-2f05eefad7ac tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:56.077936 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-014e95f2-8796-4afa-a1d5-2f05eefad7ac tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:56.078376 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-014e95f2-8796-4afa-a1d5-2f05eefad7ac tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:56.079056 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-014e95f2-8796-4afa-a1d5-2f05eefad7ac tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:46:56.079503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-014e95f2-8796-4afa-a1d5-2f05eefad7ac tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:46:56.079946 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-014e95f2-8796-4afa-a1d5-2f05eefad7ac tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:46:56.216577 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-014e95f2-8796-4afa-a1d5-2f05eefad7ac tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:56.225269 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-014e95f2-8796-4afa-a1d5-2f05eefad7ac tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:56.226806 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-014e95f2-8796-4afa-a1d5-2f05eefad7ac tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:46:56.227973 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-014e95f2-8796-4afa-a1d5-2f05eefad7ac tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1719 microversion: 2.20 time: 0.162182 Sep 06 04:46:56.228534 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 575/1169] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:46:56 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:47:10.081191 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-44ad42e5-fccc-4e6d-b147-38d737692715 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1245580827"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:47:10.081832 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-44ad42e5-fccc-4e6d-b147-38d737692715 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:10.084886 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=7 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:47:10.085585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=19 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:47:10.090260 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44ad42e5-fccc-4e6d-b147-38d737692715 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:10.090748 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44ad42e5-fccc-4e6d-b147-38d737692715 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:10.091184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44ad42e5-fccc-4e6d-b147-38d737692715 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:10.091883 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44ad42e5-fccc-4e6d-b147-38d737692715 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:10.092341 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44ad42e5-fccc-4e6d-b147-38d737692715 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:10.092769 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-44ad42e5-fccc-4e6d-b147-38d737692715 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:10.220771 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.network.security_group_api [None req-44ad42e5-fccc-4e6d-b147-38d737692715 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Removing security group 4ec43856-5c28-4762-b54f-d7dac9bb8dc5 from port 2a57860e-e2d2-4ede-943c-6db28a3cdf5a Sep 06 04:47:10.570116 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-44ad42e5-fccc-4e6d-b147-38d737692715 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "POST /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/action" status: 202 len: 0 microversion: 2.1 time: 0.492746 Sep 06 04:47:10.574050 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 595/1170] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Sep 6 04:47:10 2022] POST /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/action => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:47:10.583324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=7 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:47:10.584378 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=66 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:47:10.717534 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-aae9ab9d-e28a-4427-8b20-dbf65eafae46 req-70fcee6e-cd9f-44b0-9cc8-f6128f3418e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6c1b505-babf-4fde-b18b-7d72d9cc0acc", "tag": "2a57860e-e2d2-4ede-943c-6db28a3cdf5a"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:47:10.728669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-aae9ab9d-e28a-4427-8b20-dbf65eafae46 req-70fcee6e-cd9f-44b0-9cc8-f6128f3418e0 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:10.728669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-aae9ab9d-e28a-4427-8b20-dbf65eafae46 req-70fcee6e-cd9f-44b0-9cc8-f6128f3418e0 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:10.729224 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-aae9ab9d-e28a-4427-8b20-dbf65eafae46 req-70fcee6e-cd9f-44b0-9cc8-f6128f3418e0 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:10.741337 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-aae9ab9d-e28a-4427-8b20-dbf65eafae46 req-70fcee6e-cd9f-44b0-9cc8-f6128f3418e0 service nova] Creating event network-changed:2a57860e-e2d2-4ede-943c-6db28a3cdf5a for instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc on hv-cinder-85600 Sep 06 04:47:10.746693 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-aae9ab9d-e28a-4427-8b20-dbf65eafae46 req-70fcee6e-cd9f-44b0-9cc8-f6128f3418e0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168308 Sep 06 04:47:10.747309 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 576/1171] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:47:11.797282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-648faf6a-ab38-40f9-bc45-9baa11e6e7cf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:11.797958 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-648faf6a-ab38-40f9-bc45-9baa11e6e7cf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:11.805004 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-648faf6a-ab38-40f9-bc45-9baa11e6e7cf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:11.805550 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-648faf6a-ab38-40f9-bc45-9baa11e6e7cf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:11.806015 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-648faf6a-ab38-40f9-bc45-9baa11e6e7cf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:11.806723 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-648faf6a-ab38-40f9-bc45-9baa11e6e7cf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:11.807747 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-648faf6a-ab38-40f9-bc45-9baa11e6e7cf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:11.807747 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-648faf6a-ab38-40f9-bc45-9baa11e6e7cf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:11.855904 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-33486a4e-e236-4fde-bab6-b5ea8b6f7179 req-cfd3996b-1cf7-4bef-8983-4247e0ae4e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6c1b505-babf-4fde-b18b-7d72d9cc0acc", "tag": "2a57860e-e2d2-4ede-943c-6db28a3cdf5a"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:47:11.866602 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-33486a4e-e236-4fde-bab6-b5ea8b6f7179 req-cfd3996b-1cf7-4bef-8983-4247e0ae4e06 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:11.867365 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-33486a4e-e236-4fde-bab6-b5ea8b6f7179 req-cfd3996b-1cf7-4bef-8983-4247e0ae4e06 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:11.867805 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-33486a4e-e236-4fde-bab6-b5ea8b6f7179 req-cfd3996b-1cf7-4bef-8983-4247e0ae4e06 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:11.879348 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-33486a4e-e236-4fde-bab6-b5ea8b6f7179 req-cfd3996b-1cf7-4bef-8983-4247e0ae4e06 service nova] Creating event network-changed:2a57860e-e2d2-4ede-943c-6db28a3cdf5a for instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc on hv-cinder-85600 Sep 06 04:47:11.885179 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-33486a4e-e236-4fde-bab6-b5ea8b6f7179 req-cfd3996b-1cf7-4bef-8983-4247e0ae4e06 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101529 Sep 06 04:47:11.886428 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 596/1172] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:47:11.898811 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-648faf6a-ab38-40f9-bc45-9baa11e6e7cf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lazy-loading 'services' on Instance uuid e6c1b505-babf-4fde-b18b-7d72d9cc0acc {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:47:12.130532 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-648faf6a-ab38-40f9-bc45-9baa11e6e7cf tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/os-volume_attachments/01da4474-33a7-4326-998c-2e02371915ec" status: 202 len: 0 microversion: 2.1 time: 0.336978 Sep 06 04:47:12.131143 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 577/1173] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Sep 6 04:47:11 2022] DELETE /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/os-volume_attachments/01da4474-33a7-4326-998c-2e02371915ec => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:47:12.141067 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8cceff6b-74bb-4b72-b8ab-66034297d30c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:12.143930 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8cceff6b-74bb-4b72-b8ab-66034297d30c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:12.152838 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cceff6b-74bb-4b72-b8ab-66034297d30c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:12.153354 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cceff6b-74bb-4b72-b8ab-66034297d30c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:12.153860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cceff6b-74bb-4b72-b8ab-66034297d30c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:12.154555 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cceff6b-74bb-4b72-b8ab-66034297d30c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:12.155274 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cceff6b-74bb-4b72-b8ab-66034297d30c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:12.155727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8cceff6b-74bb-4b72-b8ab-66034297d30c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:12.187792 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8cceff6b-74bb-4b72-b8ab-66034297d30c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051588 Sep 06 04:47:12.188662 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 597/1174] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:47:12 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:47:13.201989 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-df5a6e99-6361-42fb-95cd-a2b4ce03b33d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:13.204269 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-df5a6e99-6361-42fb-95cd-a2b4ce03b33d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:13.211943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df5a6e99-6361-42fb-95cd-a2b4ce03b33d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:13.212422 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df5a6e99-6361-42fb-95cd-a2b4ce03b33d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:13.212850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df5a6e99-6361-42fb-95cd-a2b4ce03b33d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:13.213647 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df5a6e99-6361-42fb-95cd-a2b4ce03b33d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:13.214090 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df5a6e99-6361-42fb-95cd-a2b4ce03b33d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:13.214505 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-df5a6e99-6361-42fb-95cd-a2b4ce03b33d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:13.244575 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-df5a6e99-6361-42fb-95cd-a2b4ce03b33d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046949 Sep 06 04:47:13.249146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 578/1175] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:47:13 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:47:14.257192 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dba62f4d-d9d4-415d-a114-4597c1d05b4a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:14.259308 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dba62f4d-d9d4-415d-a114-4597c1d05b4a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:14.265650 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dba62f4d-d9d4-415d-a114-4597c1d05b4a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:14.266123 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dba62f4d-d9d4-415d-a114-4597c1d05b4a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:14.266556 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dba62f4d-d9d4-415d-a114-4597c1d05b4a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:14.267235 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dba62f4d-d9d4-415d-a114-4597c1d05b4a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:14.267680 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dba62f4d-d9d4-415d-a114-4597c1d05b4a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:14.268103 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dba62f4d-d9d4-415d-a114-4597c1d05b4a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:14.297627 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dba62f4d-d9d4-415d-a114-4597c1d05b4a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044710 Sep 06 04:47:14.298172 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 598/1176] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:47:14 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 04:47:14.308832 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eba75f2e-02fc-47eb-af91-8df77be5b189 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:14.309393 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-eba75f2e-02fc-47eb-af91-8df77be5b189 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:14.315566 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eba75f2e-02fc-47eb-af91-8df77be5b189 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:14.316034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eba75f2e-02fc-47eb-af91-8df77be5b189 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:14.316461 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eba75f2e-02fc-47eb-af91-8df77be5b189 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:14.317130 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eba75f2e-02fc-47eb-af91-8df77be5b189 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:14.317661 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eba75f2e-02fc-47eb-af91-8df77be5b189 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:14.318075 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eba75f2e-02fc-47eb-af91-8df77be5b189 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:14.392966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-eba75f2e-02fc-47eb-af91-8df77be5b189 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] HTTP exception thrown: Instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc is not attached to volume 01da4474-33a7-4326-998c-2e02371915ec Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eba75f2e-02fc-47eb-af91-8df77be5b189 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Request method failure captured: Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/os-volume_attachments/01da4474-33a7-4326-998c-2e02371915ec HTTP/1.1 Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs_A8V5vUvTjjNb8odasu5lv5UAAydhrCArPZUBLsKoPX7e0H6EAB6wroVKrSt5B-HzeQixdh9jtjJNvYE_nglX81MmNudzcEpMmmteXiaYE6ZKrC00ifPKsjdX3is5gQgePt_uJeL8VbXMTAMPEVcaLzMUotyzuNdOVaSHr2IfC3-s Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 623b9f3be0f24e2ea1caea0798b30704 Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-TestMinimumBasicScenario-1377050655 Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:47:14.399394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:47:14.401179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/623b9f3be0f24e2ea1caea0798b30704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/623b9f3be0f24e2ea1caea0798b30704"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_623b9f3be0f24e2ea1caea0798b30704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/623b9f3be0f24e2ea1caea0798b30704"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:47:14.401179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-TestMinimumBasicScenario-1377050655 Sep 06 04:47:14.401179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 623b9f3be0f24e2ea1caea0798b30704 Sep 06 04:47:14.401179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1377050655 Sep 06 04:47:14.401179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-TestMinimumBasicScenario-1377050655-project Sep 06 04:47:14.401179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:47:14.401179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:47:14.401179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 9f07caa54c8f47778bb984bfd9800dc0 Sep 06 04:47:14.401179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-TestMinimumBasicScenario-1377050655-project Sep 06 04:47:14.401179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:47:14.401179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc is not attached to volume 01da4474-33a7-4326-998c-2e02371915ec Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'server_id': 'e6c1b505-babf-4fde-b18b-7d72d9cc0acc', 'id': '01da4474-33a7-4326-998c-2e02371915ec'} Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 01da4474-33a7-4326-998c-2e02371915ec. Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:47:14.402280 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:47:14.403878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:47:14.403878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 06 04:47:14.403878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 06 04:47:14.403878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc is not attached to volume 01da4474-33a7-4326-998c-2e02371915ec Sep 06 04:47:14.403878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:14.403878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:14.403878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:14.403878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:14.403878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:14.403878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:14.403878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:47:14.403878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:47:14.403878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc is not attached to volume 01da4474-33a7-4326-998c-2e02371915ec Sep 06 04:47:14.403878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:14.403878 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eba75f2e-02fc-47eb-af91-8df77be5b189 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Returning 404 to user: Instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc is not attached to volume 01da4474-33a7-4326-998c-2e02371915ec {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:47:14.405534 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-eba75f2e-02fc-47eb-af91-8df77be5b189 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/os-volume_attachments/01da4474-33a7-4326-998c-2e02371915ec" status: 404 len: 154 microversion: 2.1 time: 0.095942 Sep 06 04:47:14.405534 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 579/1177] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Sep 6 04:47:14 2022] DELETE /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc/os-volume_attachments/01da4474-33a7-4326-998c-2e02371915ec => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:47:15.647774 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bd1dac11-a193-4c17-8910-f6fd8ca239c8 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:15.648268 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bd1dac11-a193-4c17-8910-f6fd8ca239c8 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:15.654671 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd1dac11-a193-4c17-8910-f6fd8ca239c8 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:15.655428 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd1dac11-a193-4c17-8910-f6fd8ca239c8 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:15.655860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd1dac11-a193-4c17-8910-f6fd8ca239c8 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:15.656537 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd1dac11-a193-4c17-8910-f6fd8ca239c8 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:15.656985 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd1dac11-a193-4c17-8910-f6fd8ca239c8 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:15.657433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bd1dac11-a193-4c17-8910-f6fd8ca239c8 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:15.685610 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bd1dac11-a193-4c17-8910-f6fd8ca239c8 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:47:15.941299 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bd1dac11-a193-4c17-8910-f6fd8ca239c8 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 204 len: 0 microversion: 2.1 time: 0.297174 Sep 06 04:47:15.941918 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 599/1178] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:47:15 2022] DELETE /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:47:15.950180 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-db28cd79-6b5c-4854-b6cd-36435872fde6 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:15.950891 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-db28cd79-6b5c-4854-b6cd-36435872fde6 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:15.957715 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db28cd79-6b5c-4854-b6cd-36435872fde6 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:15.958832 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db28cd79-6b5c-4854-b6cd-36435872fde6 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:15.959129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db28cd79-6b5c-4854-b6cd-36435872fde6 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:15.959818 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db28cd79-6b5c-4854-b6cd-36435872fde6 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:15.960269 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db28cd79-6b5c-4854-b6cd-36435872fde6 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:15.960694 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-db28cd79-6b5c-4854-b6cd-36435872fde6 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:16.092224 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-db28cd79-6b5c-4854-b6cd-36435872fde6 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:47:16.100647 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-db28cd79-6b5c-4854-b6cd-36435872fde6 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1553 microversion: 2.1 time: 0.154311 Sep 06 04:47:16.101205 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 580/1179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:15 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:47:17.123945 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-76e49584-93aa-49b8-820d-ec29b07df031 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:17.124640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-76e49584-93aa-49b8-820d-ec29b07df031 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:17.132162 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-76e49584-93aa-49b8-820d-ec29b07df031 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:17.132650 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-76e49584-93aa-49b8-820d-ec29b07df031 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:17.133089 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-76e49584-93aa-49b8-820d-ec29b07df031 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:17.133805 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-76e49584-93aa-49b8-820d-ec29b07df031 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:17.134260 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-76e49584-93aa-49b8-820d-ec29b07df031 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:17.134683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-76e49584-93aa-49b8-820d-ec29b07df031 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:17.265284 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-76e49584-93aa-49b8-820d-ec29b07df031 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:47:17.273728 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-76e49584-93aa-49b8-820d-ec29b07df031 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1553 microversion: 2.1 time: 0.153908 Sep 06 04:47:17.274297 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 600/1180] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:17 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:47:18.297277 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9abfc6b4-86ef-4764-861a-f2fe43b23d1d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:18.297870 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9abfc6b4-86ef-4764-861a-f2fe43b23d1d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:18.304744 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9abfc6b4-86ef-4764-861a-f2fe43b23d1d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:18.305224 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9abfc6b4-86ef-4764-861a-f2fe43b23d1d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:18.305685 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9abfc6b4-86ef-4764-861a-f2fe43b23d1d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:18.306373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9abfc6b4-86ef-4764-861a-f2fe43b23d1d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:18.306819 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9abfc6b4-86ef-4764-861a-f2fe43b23d1d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:18.307233 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9abfc6b4-86ef-4764-861a-f2fe43b23d1d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:18.435376 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9abfc6b4-86ef-4764-861a-f2fe43b23d1d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:47:18.443578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9abfc6b4-86ef-4764-861a-f2fe43b23d1d tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1553 microversion: 2.1 time: 0.150175 Sep 06 04:47:18.444137 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 581/1181] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:18 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:47:18.690166 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9dd47bf6-c564-4c7a-98de-34133b6bfdc3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:18.690680 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9dd47bf6-c564-4c7a-98de-34133b6bfdc3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:18.697052 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9dd47bf6-c564-4c7a-98de-34133b6bfdc3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:18.697563 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9dd47bf6-c564-4c7a-98de-34133b6bfdc3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:18.697993 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9dd47bf6-c564-4c7a-98de-34133b6bfdc3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:18.698708 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9dd47bf6-c564-4c7a-98de-34133b6bfdc3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:18.699151 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9dd47bf6-c564-4c7a-98de-34133b6bfdc3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:18.699569 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9dd47bf6-c564-4c7a-98de-34133b6bfdc3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:18.722806 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9dd47bf6-c564-4c7a-98de-34133b6bfdc3 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758/ips" status: 200 len: 151 microversion: 2.1 time: 0.163030 Sep 06 04:47:18.723386 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 601/1182] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Sep 6 04:47:18 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758/ips => generated 151 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:47:19.466858 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-520557c1-5889-4e78-96cb-3415745ac68c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:19.467381 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-520557c1-5889-4e78-96cb-3415745ac68c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:19.474527 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-520557c1-5889-4e78-96cb-3415745ac68c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:19.475007 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-520557c1-5889-4e78-96cb-3415745ac68c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:19.475448 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-520557c1-5889-4e78-96cb-3415745ac68c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:19.476133 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-520557c1-5889-4e78-96cb-3415745ac68c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:19.476583 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-520557c1-5889-4e78-96cb-3415745ac68c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:19.477001 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-520557c1-5889-4e78-96cb-3415745ac68c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:19.612943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-520557c1-5889-4e78-96cb-3415745ac68c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:47:19.620928 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-520557c1-5889-4e78-96cb-3415745ac68c tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1553 microversion: 2.1 time: 0.157961 Sep 06 04:47:19.621522 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 582/1183] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:19 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:47:20.643540 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-07724d83-7c08-4166-afcd-ded9f88c105a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:20.644064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-07724d83-7c08-4166-afcd-ded9f88c105a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:20.647275 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 04:47:20.647455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Tue Sep 6 04:47:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc (ip 10.222.0.30) !!! Sep 06 04:47:20.653580 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07724d83-7c08-4166-afcd-ded9f88c105a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:20.654072 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07724d83-7c08-4166-afcd-ded9f88c105a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:20.654513 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07724d83-7c08-4166-afcd-ded9f88c105a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:20.655466 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07724d83-7c08-4166-afcd-ded9f88c105a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:20.655926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07724d83-7c08-4166-afcd-ded9f88c105a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:20.656353 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-07724d83-7c08-4166-afcd-ded9f88c105a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:20.789364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-07724d83-7c08-4166-afcd-ded9f88c105a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:47:20.797013 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-07724d83-7c08-4166-afcd-ded9f88c105a tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1553 microversion: 2.1 time: 0.157454 Sep 06 04:47:20.797619 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 602/1184] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:20 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:47:21.819318 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ea3724a8-67eb-48d2-b842-4d2dcab50ddd tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:21.819922 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ea3724a8-67eb-48d2-b842-4d2dcab50ddd tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:21.826469 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea3724a8-67eb-48d2-b842-4d2dcab50ddd tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:21.826949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea3724a8-67eb-48d2-b842-4d2dcab50ddd tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:21.827378 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea3724a8-67eb-48d2-b842-4d2dcab50ddd tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:21.828059 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea3724a8-67eb-48d2-b842-4d2dcab50ddd tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:21.828504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea3724a8-67eb-48d2-b842-4d2dcab50ddd tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:21.828924 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ea3724a8-67eb-48d2-b842-4d2dcab50ddd tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:21.954410 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ea3724a8-67eb-48d2-b842-4d2dcab50ddd tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:47:21.963268 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ea3724a8-67eb-48d2-b842-4d2dcab50ddd tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1553 microversion: 2.1 time: 0.147704 Sep 06 04:47:21.963876 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 583/1185] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:21 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:47:22.986314 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5d2d94ec-a892-4ab7-90e6-ad10f511d1ac tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:22.986919 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5d2d94ec-a892-4ab7-90e6-ad10f511d1ac tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:22.993435 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d2d94ec-a892-4ab7-90e6-ad10f511d1ac tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:22.993917 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d2d94ec-a892-4ab7-90e6-ad10f511d1ac tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:22.994347 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d2d94ec-a892-4ab7-90e6-ad10f511d1ac tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:22.995024 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d2d94ec-a892-4ab7-90e6-ad10f511d1ac tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:22.995470 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d2d94ec-a892-4ab7-90e6-ad10f511d1ac tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:22.995889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5d2d94ec-a892-4ab7-90e6-ad10f511d1ac tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:23.125293 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5d2d94ec-a892-4ab7-90e6-ad10f511d1ac tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:47:23.133666 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5d2d94ec-a892-4ab7-90e6-ad10f511d1ac tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1553 microversion: 2.1 time: 0.151155 Sep 06 04:47:23.134231 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 603/1186] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:22 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:47:24.157636 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4b303795-c21c-41c0-8d94-7b6281883ee2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:24.158237 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4b303795-c21c-41c0-8d94-7b6281883ee2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:24.165624 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b303795-c21c-41c0-8d94-7b6281883ee2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:24.166097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b303795-c21c-41c0-8d94-7b6281883ee2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:24.166524 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b303795-c21c-41c0-8d94-7b6281883ee2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:24.167238 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b303795-c21c-41c0-8d94-7b6281883ee2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:24.167668 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b303795-c21c-41c0-8d94-7b6281883ee2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:24.168080 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4b303795-c21c-41c0-8d94-7b6281883ee2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:24.305635 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4b303795-c21c-41c0-8d94-7b6281883ee2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:47:24.313391 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4b303795-c21c-41c0-8d94-7b6281883ee2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1553 microversion: 2.1 time: 0.159912 Sep 06 04:47:24.313961 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 584/1187] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:24 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:47:25.332550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-b60f65e7-2547-46f7-9caa-42f7248a0b53 req-ba72fbd9-8bb6-40ae-9850-b57cc8c9feb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6c1b505-babf-4fde-b18b-7d72d9cc0acc", "name": "network-vif-deleted", "tag": "2a57860e-e2d2-4ede-943c-6db28a3cdf5a"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:47:25.340712 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-47051fc9-3664-498f-8dcf-65ff86c1e1f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:25.342585 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-47051fc9-3664-498f-8dcf-65ff86c1e1f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:25.349484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47051fc9-3664-498f-8dcf-65ff86c1e1f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:25.349702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b60f65e7-2547-46f7-9caa-42f7248a0b53 req-ba72fbd9-8bb6-40ae-9850-b57cc8c9feb6 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:25.349965 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47051fc9-3664-498f-8dcf-65ff86c1e1f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:25.350088 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b60f65e7-2547-46f7-9caa-42f7248a0b53 req-ba72fbd9-8bb6-40ae-9850-b57cc8c9feb6 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:25.350446 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47051fc9-3664-498f-8dcf-65ff86c1e1f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:25.350561 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b60f65e7-2547-46f7-9caa-42f7248a0b53 req-ba72fbd9-8bb6-40ae-9850-b57cc8c9feb6 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:25.351175 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47051fc9-3664-498f-8dcf-65ff86c1e1f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:25.351615 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47051fc9-3664-498f-8dcf-65ff86c1e1f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:25.352037 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-47051fc9-3664-498f-8dcf-65ff86c1e1f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:25.362287 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-b60f65e7-2547-46f7-9caa-42f7248a0b53 req-ba72fbd9-8bb6-40ae-9850-b57cc8c9feb6 service nova] Creating event network-vif-deleted:2a57860e-e2d2-4ede-943c-6db28a3cdf5a for instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc on hv-cinder-85600 Sep 06 04:47:25.368068 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-b60f65e7-2547-46f7-9caa-42f7248a0b53 req-ba72fbd9-8bb6-40ae-9850-b57cc8c9feb6 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038941 Sep 06 04:47:25.368701 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 604/1188] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:47:25.414566 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-47051fc9-3664-498f-8dcf-65ff86c1e1f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:47:25.422425 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-47051fc9-3664-498f-8dcf-65ff86c1e1f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1511 microversion: 2.1 time: 0.089536 Sep 06 04:47:25.422994 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 585/1189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:25 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1511 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:47:26.446355 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-638b8ef9-2d4a-418e-a398-a13c8b4a8fd2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:26.447037 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-638b8ef9-2d4a-418e-a398-a13c8b4a8fd2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:26.453661 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-638b8ef9-2d4a-418e-a398-a13c8b4a8fd2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:26.454139 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-638b8ef9-2d4a-418e-a398-a13c8b4a8fd2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:26.454573 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-638b8ef9-2d4a-418e-a398-a13c8b4a8fd2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:26.455257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-638b8ef9-2d4a-418e-a398-a13c8b4a8fd2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:26.455703 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-638b8ef9-2d4a-418e-a398-a13c8b4a8fd2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:26.456138 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-638b8ef9-2d4a-418e-a398-a13c8b4a8fd2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:26.491485 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-638b8ef9-2d4a-418e-a398-a13c8b4a8fd2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:26.492049 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-638b8ef9-2d4a-418e-a398-a13c8b4a8fd2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:26.492485 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-638b8ef9-2d4a-418e-a398-a13c8b4a8fd2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:26.492940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-638b8ef9-2d4a-418e-a398-a13c8b4a8fd2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lazy-loading 'fault' on Instance uuid e6c1b505-babf-4fde-b18b-7d72d9cc0acc {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:47:26.545875 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-638b8ef9-2d4a-418e-a398-a13c8b4a8fd2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f07caa54c8f47778bb984bfd9800dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623b9f3be0f24e2ea1caea0798b30704', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:47:26.554222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-638b8ef9-2d4a-418e-a398-a13c8b4a8fd2 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 200 len: 1347 microversion: 2.1 time: 0.112216 Sep 06 04:47:26.554704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5cc5cfda-c67e-4471-96df-e2bca95bf727 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3de4aa0-667c-4424-9963-3debb10a48b1"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:47:26.557792 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 605/1190] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:26 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 1347 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:47:26.557909 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5cc5cfda-c67e-4471-96df-e2bca95bf727 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:26.564049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cc5cfda-c67e-4471-96df-e2bca95bf727 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:26.564534 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cc5cfda-c67e-4471-96df-e2bca95bf727 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:26.564965 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cc5cfda-c67e-4471-96df-e2bca95bf727 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:26.565690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cc5cfda-c67e-4471-96df-e2bca95bf727 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:26.566322 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cc5cfda-c67e-4471-96df-e2bca95bf727 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:26.566747 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5cc5cfda-c67e-4471-96df-e2bca95bf727 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:27.385516 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5cc5cfda-c67e-4471-96df-e2bca95bf727 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "POST /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834504 Sep 06 04:47:27.386496 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 586/1191] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Sep 6 04:47:26 2022] POST /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:47:27.578831 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e6076e72-c6c7-4b77-b52c-66e7ea5120f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:27.582311 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-e6076e72-c6c7-4b77-b52c-66e7ea5120f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] [instance: e6c1b505-babf-4fde-b18b-7d72d9cc0acc] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:27.586931 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6076e72-c6c7-4b77-b52c-66e7ea5120f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:27.587413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6076e72-c6c7-4b77-b52c-66e7ea5120f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:27.587847 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6076e72-c6c7-4b77-b52c-66e7ea5120f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:27.588538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6076e72-c6c7-4b77-b52c-66e7ea5120f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:27.589055 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6076e72-c6c7-4b77-b52c-66e7ea5120f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:27.589509 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-e6076e72-c6c7-4b77-b52c-66e7ea5120f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:27.602939 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-e6076e72-c6c7-4b77-b52c-66e7ea5120f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] HTTP exception thrown: Instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc could not be found. Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e6076e72-c6c7-4b77-b52c-66e7ea5120f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Request method failure captured: Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc HTTP/1.1 Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs_A8V5vUvTjjNb8odasu5lv5UAAydhrCArPZUBLsKoPX7e0H6EAB6wroVKrSt5B-HzeQixdh9jtjJNvYE_nglX81MmNudzcEpMmmteXiaYE6ZKrC00ifPKsjdX3is5gQgePt_uJeL8VbXMTAMPEVcaLzMUotyzuNdOVaSHr2IfC3-s Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 623b9f3be0f24e2ea1caea0798b30704 Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-TestMinimumBasicScenario-1377050655 Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:47:27.604585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:47:27.606300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/623b9f3be0f24e2ea1caea0798b30704"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/623b9f3be0f24e2ea1caea0798b30704"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_623b9f3be0f24e2ea1caea0798b30704"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/623b9f3be0f24e2ea1caea0798b30704"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:47:27.606300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-TestMinimumBasicScenario-1377050655 Sep 06 04:47:27.606300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 623b9f3be0f24e2ea1caea0798b30704 Sep 06 04:47:27.606300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1377050655 Sep 06 04:47:27.606300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-TestMinimumBasicScenario-1377050655-project Sep 06 04:47:27.606300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:47:27.606300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:47:27.606300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 9f07caa54c8f47778bb984bfd9800dc0 Sep 06 04:47:27.606300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-TestMinimumBasicScenario-1377050655-project Sep 06 04:47:27.606300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:47:27.606300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc could not be found. Sep 06 04:47:27.606300 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': 'e6c1b505-babf-4fde-b18b-7d72d9cc0acc'} Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc could not be found. Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:47:27.607239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc could not be found. Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc could not be found. Sep 06 04:47:27.608791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:27.610848 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-e6076e72-c6c7-4b77-b52c-66e7ea5120f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Returning 404 to user: Instance e6c1b505-babf-4fde-b18b-7d72d9cc0acc could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:47:27.610848 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-e6076e72-c6c7-4b77-b52c-66e7ea5120f1 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc" status: 404 len: 111 microversion: 2.1 time: 0.031084 Sep 06 04:47:27.610848 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 606/1192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:27 2022] GET /compute/v2.1/servers/e6c1b505-babf-4fde-b18b-7d72d9cc0acc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:47:27.615295 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6e7c6c63-ba47-4f72-b1ff-4a3635e6ab45 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] Calling method '.version_select at 0x7f3176579160>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:27.736546 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6e7c6c63-ba47-4f72-b1ff-4a3635e6ab45 tempest-TestMinimumBasicScenario-1377050655 tempest-TestMinimumBasicScenario-1377050655-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-370372830" status: 202 len: 0 microversion: 2.1 time: 0.125288 Sep 06 04:47:27.737104 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 587/1193] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Sep 6 04:47:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-370372830 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:47:36.165681 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0626fbc3-406a-4c81-9443-6447e8ce6caf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:36.166309 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0626fbc3-406a-4c81-9443-6447e8ce6caf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:36.173177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0626fbc3-406a-4c81-9443-6447e8ce6caf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:36.173885 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0626fbc3-406a-4c81-9443-6447e8ce6caf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:36.174328 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0626fbc3-406a-4c81-9443-6447e8ce6caf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:36.175071 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0626fbc3-406a-4c81-9443-6447e8ce6caf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:36.175585 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0626fbc3-406a-4c81-9443-6447e8ce6caf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:36.176007 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0626fbc3-406a-4c81-9443-6447e8ce6caf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:36.266599 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-0626fbc3-406a-4c81-9443-6447e8ce6caf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lazy-loading 'services' on Instance uuid 258d81b1-09b8-4462-88d2-c588852c8758 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:47:36.512522 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0626fbc3-406a-4c81-9443-6447e8ce6caf tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "DELETE /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758/os-volume_attachments/a3de4aa0-667c-4424-9963-3debb10a48b1" status: 202 len: 0 microversion: 2.1 time: 0.361502 Sep 06 04:47:36.513142 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 607/1194] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Sep 6 04:47:36 2022] DELETE /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758/os-volume_attachments/a3de4aa0-667c-4424-9963-3debb10a48b1 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:47:36.522758 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eb7a31f1-06a8-4071-af6f-2b6669e04ef1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:36.525980 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-eb7a31f1-06a8-4071-af6f-2b6669e04ef1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:36.533486 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb7a31f1-06a8-4071-af6f-2b6669e04ef1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:36.533966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb7a31f1-06a8-4071-af6f-2b6669e04ef1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:36.534398 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb7a31f1-06a8-4071-af6f-2b6669e04ef1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:36.535126 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb7a31f1-06a8-4071-af6f-2b6669e04ef1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:36.535574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb7a31f1-06a8-4071-af6f-2b6669e04ef1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:36.535997 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eb7a31f1-06a8-4071-af6f-2b6669e04ef1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:36.569691 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-eb7a31f1-06a8-4071-af6f-2b6669e04ef1 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051950 Sep 06 04:47:36.570788 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 588/1195] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:47:36 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:47:37.584345 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a8641082-e65b-4804-add1-ca90f78eb924 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:37.587322 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a8641082-e65b-4804-add1-ca90f78eb924 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:37.593696 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8641082-e65b-4804-add1-ca90f78eb924 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:37.594177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8641082-e65b-4804-add1-ca90f78eb924 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:37.594617 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8641082-e65b-4804-add1-ca90f78eb924 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:37.595369 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8641082-e65b-4804-add1-ca90f78eb924 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:37.595857 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8641082-e65b-4804-add1-ca90f78eb924 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:37.596253 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a8641082-e65b-4804-add1-ca90f78eb924 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:37.629944 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a8641082-e65b-4804-add1-ca90f78eb924 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050821 Sep 06 04:47:37.630905 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 608/1196] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:47:37 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:47:38.642617 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-feb0f329-3bda-4c7b-8678-34a904545a4d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:38.644684 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-feb0f329-3bda-4c7b-8678-34a904545a4d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:38.652068 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-feb0f329-3bda-4c7b-8678-34a904545a4d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:38.652544 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-feb0f329-3bda-4c7b-8678-34a904545a4d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:38.652977 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-feb0f329-3bda-4c7b-8678-34a904545a4d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:38.653691 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-feb0f329-3bda-4c7b-8678-34a904545a4d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:38.654145 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-feb0f329-3bda-4c7b-8678-34a904545a4d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:38.654563 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-feb0f329-3bda-4c7b-8678-34a904545a4d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:38.683991 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-feb0f329-3bda-4c7b-8678-34a904545a4d tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045418 Sep 06 04:47:38.684543 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 589/1197] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:47:38 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 04:47:38.748397 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-54b39608-8e7c-4e4c-be17-5382fbee75d9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:38.748890 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-54b39608-8e7c-4e4c-be17-5382fbee75d9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:38.755199 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-54b39608-8e7c-4e4c-be17-5382fbee75d9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:38.765582 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-54b39608-8e7c-4e4c-be17-5382fbee75d9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:38.765582 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-54b39608-8e7c-4e4c-be17-5382fbee75d9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:38.765582 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-54b39608-8e7c-4e4c-be17-5382fbee75d9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:38.765582 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-54b39608-8e7c-4e4c-be17-5382fbee75d9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:38.765976 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-54b39608-8e7c-4e4c-be17-5382fbee75d9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:38.783878 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-54b39608-8e7c-4e4c-be17-5382fbee75d9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:47:38.916753 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:47:39.134195 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-54b39608-8e7c-4e4c-be17-5382fbee75d9 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "DELETE /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 204 len: 0 microversion: 2.1 time: 0.388664 Sep 06 04:47:39.134826 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 609/1198] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:47:38 2022] DELETE /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:47:39.143814 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-097562c4-4864-49b6-b91e-31594cb1cafc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:39.144426 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-097562c4-4864-49b6-b91e-31594cb1cafc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:39.155670 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-097562c4-4864-49b6-b91e-31594cb1cafc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:39.156159 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-097562c4-4864-49b6-b91e-31594cb1cafc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:39.156597 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-097562c4-4864-49b6-b91e-31594cb1cafc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:39.157288 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-097562c4-4864-49b6-b91e-31594cb1cafc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:39.157777 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-097562c4-4864-49b6-b91e-31594cb1cafc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:39.158197 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-097562c4-4864-49b6-b91e-31594cb1cafc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:39.285041 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-097562c4-4864-49b6-b91e-31594cb1cafc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:47:39.293239 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-097562c4-4864-49b6-b91e-31594cb1cafc tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1684 microversion: 2.1 time: 0.154142 Sep 06 04:47:39.293831 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 590/1199] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:39 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:47:40.318217 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-64d9242b-0612-489d-8333-16bbfa354350 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:40.319200 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-64d9242b-0612-489d-8333-16bbfa354350 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:40.322551 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:47:40.327281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64d9242b-0612-489d-8333-16bbfa354350 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:40.327765 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64d9242b-0612-489d-8333-16bbfa354350 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:40.332678 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64d9242b-0612-489d-8333-16bbfa354350 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:40.332678 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64d9242b-0612-489d-8333-16bbfa354350 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:40.332678 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64d9242b-0612-489d-8333-16bbfa354350 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:40.332678 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64d9242b-0612-489d-8333-16bbfa354350 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:40.462473 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-64d9242b-0612-489d-8333-16bbfa354350 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:47:40.470318 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-64d9242b-0612-489d-8333-16bbfa354350 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1684 microversion: 2.1 time: 0.156381 Sep 06 04:47:40.470895 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 610/1200] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:40 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:47:41.494480 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5b28cdf2-d0c1-4a8b-9eb3-26feb247cee6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:41.495136 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5b28cdf2-d0c1-4a8b-9eb3-26feb247cee6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:41.497565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:47:41.502284 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5b28cdf2-d0c1-4a8b-9eb3-26feb247cee6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:41.502768 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5b28cdf2-d0c1-4a8b-9eb3-26feb247cee6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:41.510513 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5b28cdf2-d0c1-4a8b-9eb3-26feb247cee6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:41.510513 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5b28cdf2-d0c1-4a8b-9eb3-26feb247cee6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:41.510513 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5b28cdf2-d0c1-4a8b-9eb3-26feb247cee6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:41.510513 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5b28cdf2-d0c1-4a8b-9eb3-26feb247cee6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:41.511141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:47:41.640955 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5b28cdf2-d0c1-4a8b-9eb3-26feb247cee6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:47:41.648650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5b28cdf2-d0c1-4a8b-9eb3-26feb247cee6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1684 microversion: 2.1 time: 0.158154 Sep 06 04:47:41.650414 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 591/1201] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:41 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:47:42.251211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-cd04e407-7e18-4b63-8061-a1f8545eaa5e req-35d5c438-8bdb-4216-80bc-7834e39b6a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "258d81b1-09b8-4462-88d2-c588852c8758", "name": "network-vif-deleted", "tag": "99bb1003-b352-4698-b9a1-9dd6c82752f6"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:47:42.263308 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-cd04e407-7e18-4b63-8061-a1f8545eaa5e req-35d5c438-8bdb-4216-80bc-7834e39b6a03 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:42.264046 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-cd04e407-7e18-4b63-8061-a1f8545eaa5e req-35d5c438-8bdb-4216-80bc-7834e39b6a03 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:42.264541 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-cd04e407-7e18-4b63-8061-a1f8545eaa5e req-35d5c438-8bdb-4216-80bc-7834e39b6a03 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:42.275851 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-cd04e407-7e18-4b63-8061-a1f8545eaa5e req-35d5c438-8bdb-4216-80bc-7834e39b6a03 service nova] Creating event network-vif-deleted:99bb1003-b352-4698-b9a1-9dd6c82752f6 for instance 258d81b1-09b8-4462-88d2-c588852c8758 on hv-cinder-85600 Sep 06 04:47:42.281482 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-cd04e407-7e18-4b63-8061-a1f8545eaa5e req-35d5c438-8bdb-4216-80bc-7834e39b6a03 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034289 Sep 06 04:47:42.282419 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 611/1202] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:47:42.674056 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6df93b11-c19b-4096-b89a-03f35e2ce48b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:42.674690 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6df93b11-c19b-4096-b89a-03f35e2ce48b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:42.682004 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df93b11-c19b-4096-b89a-03f35e2ce48b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:42.682499 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df93b11-c19b-4096-b89a-03f35e2ce48b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:42.682993 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df93b11-c19b-4096-b89a-03f35e2ce48b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:42.683817 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df93b11-c19b-4096-b89a-03f35e2ce48b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:42.684268 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df93b11-c19b-4096-b89a-03f35e2ce48b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:42.684819 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df93b11-c19b-4096-b89a-03f35e2ce48b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:42.759820 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df93b11-c19b-4096-b89a-03f35e2ce48b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:42.760310 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df93b11-c19b-4096-b89a-03f35e2ce48b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:42.760749 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df93b11-c19b-4096-b89a-03f35e2ce48b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:42.761207 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-6df93b11-c19b-4096-b89a-03f35e2ce48b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lazy-loading 'fault' on Instance uuid 258d81b1-09b8-4462-88d2-c588852c8758 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:47:42.802879 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6df93b11-c19b-4096-b89a-03f35e2ce48b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a0294ea40914bf290902307a787642d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d04ba57221f42d684873d624dbfd283', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:47:42.810528 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6df93b11-c19b-4096-b89a-03f35e2ce48b tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 200 len: 1332 microversion: 2.1 time: 0.140366 Sep 06 04:47:42.811113 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 592/1203] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:42 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 1332 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:47:43.833489 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-103ac178-7b75-4a09-9b74-6a6c1211bbeb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:43.834179 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-103ac178-7b75-4a09-9b74-6a6c1211bbeb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:43.843017 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-103ac178-7b75-4a09-9b74-6a6c1211bbeb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:43.843490 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-103ac178-7b75-4a09-9b74-6a6c1211bbeb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:43.843920 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-103ac178-7b75-4a09-9b74-6a6c1211bbeb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:43.844636 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-103ac178-7b75-4a09-9b74-6a6c1211bbeb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:43.845083 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-103ac178-7b75-4a09-9b74-6a6c1211bbeb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:43.845534 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-103ac178-7b75-4a09-9b74-6a6c1211bbeb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:43.858869 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-103ac178-7b75-4a09-9b74-6a6c1211bbeb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] HTTP exception thrown: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-103ac178-7b75-4a09-9b74-6a6c1211bbeb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Request method failure captured: Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 HTTP/1.1 Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs4RQ2W0jAEqmIc2a2gyZUln8p5bNCm0_mI8D5F27-XVkP7ATAOu468pXcxlEjqoKhC2riGskVgaopgp2mx1B-_JnDX9K5NgGMMIQuXdxY4mBudlKUObSTI_UiuCCeDA5-u77rF7VJ2ZfC_NCmQ-YCsbSULwwvYBOkysYcpX20qWbNI Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:47:43.860459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:47:43.862033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d04ba57221f42d684873d624dbfd283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:47:43.862033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:43.862033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:43.862033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:43.862033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:43.862033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:47:43.862033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:47:43.862033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 5a0294ea40914bf290902307a787642d Sep 06 04:47:43.862033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:43.862033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:47:43.862033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. Sep 06 04:47:43.862033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '258d81b1-09b8-4462-88d2-c588852c8758'} Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:47:43.862889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. Sep 06 04:47:43.864554 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:43.866349 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-103ac178-7b75-4a09-9b74-6a6c1211bbeb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Returning 404 to user: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:47:43.866349 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-103ac178-7b75-4a09-9b74-6a6c1211bbeb tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 404 len: 111 microversion: 2.1 time: 0.032602 Sep 06 04:47:43.866349 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 612/1204] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:43 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:47:43.871003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-be80e179-127c-4a77-a731-f7cab9f87220 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '.version_select at 0x7f3176694430>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:43.957758 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-be80e179-127c-4a77-a731-f7cab9f87220 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502740357" status: 202 len: 0 microversion: 2.1 time: 0.090706 Sep 06 04:47:43.958266 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 593/1205] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Sep 6 04:47:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1502740357 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:47:45.933824 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9010fef8-c2e9-4492-9e4b-e21a67b5b0d6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:45.934445 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9010fef8-c2e9-4492-9e4b-e21a67b5b0d6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:45.940854 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9010fef8-c2e9-4492-9e4b-e21a67b5b0d6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:45.941268 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9010fef8-c2e9-4492-9e4b-e21a67b5b0d6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:45.941729 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9010fef8-c2e9-4492-9e4b-e21a67b5b0d6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:45.942410 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9010fef8-c2e9-4492-9e4b-e21a67b5b0d6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:45.942854 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9010fef8-c2e9-4492-9e4b-e21a67b5b0d6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:45.943270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9010fef8-c2e9-4492-9e4b-e21a67b5b0d6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:45.956755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-9010fef8-c2e9-4492-9e4b-e21a67b5b0d6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] HTTP exception thrown: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9010fef8-c2e9-4492-9e4b-e21a67b5b0d6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Request method failure captured: Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 HTTP/1.1 Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs4RQ2W0jAEqmIc2a2gyZUln8p5bNCm0_mI8D5F27-XVkP7ATAOu468pXcxlEjqoKhC2riGskVgaopgp2mx1B-_JnDX9K5NgGMMIQuXdxY4mBudlKUObSTI_UiuCCeDA5-u77rF7VJ2ZfC_NCmQ-YCsbSULwwvYBOkysYcpX20qWbNI Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:47:45.958333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:47:45.963177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d04ba57221f42d684873d624dbfd283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:47:45.963177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:45.963177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:45.963177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:45.963177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:45.963177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:47:45.963177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:47:45.963177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 5a0294ea40914bf290902307a787642d Sep 06 04:47:45.963177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:45.963177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:47:45.963177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. Sep 06 04:47:45.963177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '258d81b1-09b8-4462-88d2-c588852c8758'} Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:47:45.964267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. Sep 06 04:47:45.965828 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:45.967375 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9010fef8-c2e9-4492-9e4b-e21a67b5b0d6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Returning 404 to user: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:47:45.967375 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9010fef8-c2e9-4492-9e4b-e21a67b5b0d6 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "DELETE /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 404 len: 111 microversion: 2.1 time: 0.029875 Sep 06 04:47:45.967375 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 613/1206] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:47:45 2022] DELETE /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:47:45.968596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e55e6016-922e-48cc-bb6f-a9b4a43c4226 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:45.969215 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-e55e6016-922e-48cc-bb6f-a9b4a43c4226 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 258d81b1-09b8-4462-88d2-c588852c8758] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:45.976300 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e55e6016-922e-48cc-bb6f-a9b4a43c4226 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:45.976779 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e55e6016-922e-48cc-bb6f-a9b4a43c4226 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:45.977213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e55e6016-922e-48cc-bb6f-a9b4a43c4226 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:45.978672 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e55e6016-922e-48cc-bb6f-a9b4a43c4226 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:45.979454 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e55e6016-922e-48cc-bb6f-a9b4a43c4226 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:45.980090 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-e55e6016-922e-48cc-bb6f-a9b4a43c4226 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:45.993459 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-e55e6016-922e-48cc-bb6f-a9b4a43c4226 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] HTTP exception thrown: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e55e6016-922e-48cc-bb6f-a9b4a43c4226 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Request method failure captured: Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 HTTP/1.1 Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4RQ2W0jAEqmIc2a2gyZUln8p5bNCm0_mI8D5F27-XVkP7ATAOu468pXcxlEjqoKhC2riGskVgaopgp2mx1B-_JnDX9K5NgGMMIQuXdxY4mBudlKUObSTI_UiuCCeDA5-u77rF7VJ2ZfC_NCmQ-YCsbSULwwvYBOkysYcpX20qWbNI Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:47:45.995088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:47:45.996771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d04ba57221f42d684873d624dbfd283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:47:45.996771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:45.996771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:45.996771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:45.996771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:45.996771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:47:45.996771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:47:45.996771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 5a0294ea40914bf290902307a787642d Sep 06 04:47:45.996771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:45.996771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:47:45.996771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. Sep 06 04:47:45.996771 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '258d81b1-09b8-4462-88d2-c588852c8758'} Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:47:45.997839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. Sep 06 04:47:45.999189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:46.000396 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-e55e6016-922e-48cc-bb6f-a9b4a43c4226 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Returning 404 to user: Instance 258d81b1-09b8-4462-88d2-c588852c8758 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:47:46.000396 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e55e6016-922e-48cc-bb6f-a9b4a43c4226 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758" status: 404 len: 111 microversion: 2.1 time: 0.031702 Sep 06 04:47:46.000396 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 594/1207] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:45 2022] GET /compute/v2.1/servers/258d81b1-09b8-4462-88d2-c588852c8758 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:47:47.291216 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-392557ff-18a0-4812-8cd1-c38856b54e47 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:47.291741 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-392557ff-18a0-4812-8cd1-c38856b54e47 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:47.298568 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-392557ff-18a0-4812-8cd1-c38856b54e47 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:47.307028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-392557ff-18a0-4812-8cd1-c38856b54e47 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:47.307028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-392557ff-18a0-4812-8cd1-c38856b54e47 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:47.307028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-392557ff-18a0-4812-8cd1-c38856b54e47 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:47.307028 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-392557ff-18a0-4812-8cd1-c38856b54e47 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:47.307425 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-392557ff-18a0-4812-8cd1-c38856b54e47 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:47.315588 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-392557ff-18a0-4812-8cd1-c38856b54e47 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] HTTP exception thrown: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-392557ff-18a0-4812-8cd1-c38856b54e47 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Request method failure captured: Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d HTTP/1.1 Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs4RQ2W0jAEqmIc2a2gyZUln8p5bNCm0_mI8D5F27-XVkP7ATAOu468pXcxlEjqoKhC2riGskVgaopgp2mx1B-_JnDX9K5NgGMMIQuXdxY4mBudlKUObSTI_UiuCCeDA5-u77rF7VJ2ZfC_NCmQ-YCsbSULwwvYBOkysYcpX20qWbNI Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:47:47.317100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:47:47.318815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d04ba57221f42d684873d624dbfd283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:47:47.318815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:47.318815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:47.318815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:47.318815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:47.318815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:47:47.318815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:47:47.318815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 5a0294ea40914bf290902307a787642d Sep 06 04:47:47.318815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:47.318815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:47:47.318815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. Sep 06 04:47:47.318815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '6059864b-289a-4aa6-85b9-9041ca7e9d2d'} Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:47:47.319682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. Sep 06 04:47:47.321016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.323051 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-392557ff-18a0-4812-8cd1-c38856b54e47 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Returning 404 to user: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:47:47.323051 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-392557ff-18a0-4812-8cd1-c38856b54e47 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "DELETE /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 404 len: 111 microversion: 2.1 time: 0.031450 Sep 06 04:47:47.323051 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 614/1208] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:47:47 2022] DELETE /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:47:47.328005 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-76f2e7cb-afc9-4ef6-8d20-b187e6e81aa7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:47.330017 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-76f2e7cb-afc9-4ef6-8d20-b187e6e81aa7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 6059864b-289a-4aa6-85b9-9041ca7e9d2d] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:47.335206 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76f2e7cb-afc9-4ef6-8d20-b187e6e81aa7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:47.335692 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76f2e7cb-afc9-4ef6-8d20-b187e6e81aa7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:47.336129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76f2e7cb-afc9-4ef6-8d20-b187e6e81aa7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:47.336817 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76f2e7cb-afc9-4ef6-8d20-b187e6e81aa7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:47.337291 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76f2e7cb-afc9-4ef6-8d20-b187e6e81aa7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:47.337778 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-76f2e7cb-afc9-4ef6-8d20-b187e6e81aa7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:47.351519 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-76f2e7cb-afc9-4ef6-8d20-b187e6e81aa7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] HTTP exception thrown: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-76f2e7cb-afc9-4ef6-8d20-b187e6e81aa7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Request method failure captured: Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d HTTP/1.1 Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4RQ2W0jAEqmIc2a2gyZUln8p5bNCm0_mI8D5F27-XVkP7ATAOu468pXcxlEjqoKhC2riGskVgaopgp2mx1B-_JnDX9K5NgGMMIQuXdxY4mBudlKUObSTI_UiuCCeDA5-u77rF7VJ2ZfC_NCmQ-YCsbSULwwvYBOkysYcpX20qWbNI Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:47:47.353299 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:47:47.356827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d04ba57221f42d684873d624dbfd283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:47:47.356827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:47.356827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:47.356827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:47.356827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:47.356827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:47:47.356827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:47:47.356827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 5a0294ea40914bf290902307a787642d Sep 06 04:47:47.356827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:47.356827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:47:47.356827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. Sep 06 04:47:47.356827 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '6059864b-289a-4aa6-85b9-9041ca7e9d2d'} Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:47:47.357673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. Sep 06 04:47:47.358950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.360351 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-76f2e7cb-afc9-4ef6-8d20-b187e6e81aa7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Returning 404 to user: Instance 6059864b-289a-4aa6-85b9-9041ca7e9d2d could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:47:47.360351 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-76f2e7cb-afc9-4ef6-8d20-b187e6e81aa7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d" status: 404 len: 111 microversion: 2.1 time: 0.030867 Sep 06 04:47:47.360351 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 595/1209] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:47 2022] GET /compute/v2.1/servers/6059864b-289a-4aa6-85b9-9041ca7e9d2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:47:47.363416 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-40301c81-3ba4-48b3-a953-747c983128de tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:47.363916 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-40301c81-3ba4-48b3-a953-747c983128de tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:47.370563 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40301c81-3ba4-48b3-a953-747c983128de tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:47.371043 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40301c81-3ba4-48b3-a953-747c983128de tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:47.371479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40301c81-3ba4-48b3-a953-747c983128de tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:47.372180 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40301c81-3ba4-48b3-a953-747c983128de tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:47.372640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40301c81-3ba4-48b3-a953-747c983128de tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:47.373063 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-40301c81-3ba4-48b3-a953-747c983128de tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:47.389489 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-40301c81-3ba4-48b3-a953-747c983128de tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] HTTP exception thrown: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-40301c81-3ba4-48b3-a953-747c983128de tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Request method failure captured: Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 HTTP/1.1 Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs4RQ2W0jAEqmIc2a2gyZUln8p5bNCm0_mI8D5F27-XVkP7ATAOu468pXcxlEjqoKhC2riGskVgaopgp2mx1B-_JnDX9K5NgGMMIQuXdxY4mBudlKUObSTI_UiuCCeDA5-u77rF7VJ2ZfC_NCmQ-YCsbSULwwvYBOkysYcpX20qWbNI Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:47:47.391029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:47:47.392736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d04ba57221f42d684873d624dbfd283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:47:47.392736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:47.392736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:47.392736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:47.392736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:47.392736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:47:47.392736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:47:47.392736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 5a0294ea40914bf290902307a787642d Sep 06 04:47:47.392736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:47.392736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:47:47.392736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. Sep 06 04:47:47.392736 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '16044770-064c-404f-9a5e-c3c493e8a869'} Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:47:47.393770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. Sep 06 04:47:47.395257 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.397026 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-40301c81-3ba4-48b3-a953-747c983128de tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Returning 404 to user: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:47:47.397026 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-40301c81-3ba4-48b3-a953-747c983128de tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "DELETE /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 404 len: 111 microversion: 2.1 time: 0.033352 Sep 06 04:47:47.397026 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 615/1210] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:47:47 2022] DELETE /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 04:47:47.401965 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-efb2aa0a-62f4-4bdb-b609-da2927001332 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:47.402595 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-efb2aa0a-62f4-4bdb-b609-da2927001332 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 16044770-064c-404f-9a5e-c3c493e8a869] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:47.408762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efb2aa0a-62f4-4bdb-b609-da2927001332 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:47.409271 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efb2aa0a-62f4-4bdb-b609-da2927001332 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:47.409727 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efb2aa0a-62f4-4bdb-b609-da2927001332 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:47.410404 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efb2aa0a-62f4-4bdb-b609-da2927001332 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:47.410847 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efb2aa0a-62f4-4bdb-b609-da2927001332 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:47.411258 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-efb2aa0a-62f4-4bdb-b609-da2927001332 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:47.426251 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-efb2aa0a-62f4-4bdb-b609-da2927001332 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] HTTP exception thrown: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-efb2aa0a-62f4-4bdb-b609-da2927001332 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Request method failure captured: Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 HTTP/1.1 Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4RQ2W0jAEqmIc2a2gyZUln8p5bNCm0_mI8D5F27-XVkP7ATAOu468pXcxlEjqoKhC2riGskVgaopgp2mx1B-_JnDX9K5NgGMMIQuXdxY4mBudlKUObSTI_UiuCCeDA5-u77rF7VJ2ZfC_NCmQ-YCsbSULwwvYBOkysYcpX20qWbNI Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:47:47.427741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:47:47.429452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d04ba57221f42d684873d624dbfd283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:47:47.429452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:47.429452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:47.429452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:47.429452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:47.429452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:47:47.429452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:47:47.429452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 5a0294ea40914bf290902307a787642d Sep 06 04:47:47.429452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:47.429452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:47:47.429452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. Sep 06 04:47:47.429452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '16044770-064c-404f-9a5e-c3c493e8a869'} Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:47:47.430394 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. Sep 06 04:47:47.432440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:47.433912 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-efb2aa0a-62f4-4bdb-b609-da2927001332 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Returning 404 to user: Instance 16044770-064c-404f-9a5e-c3c493e8a869 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:47:47.433912 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-efb2aa0a-62f4-4bdb-b609-da2927001332 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869" status: 404 len: 111 microversion: 2.1 time: 0.031005 Sep 06 04:47:47.433912 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 596/1211] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:47 2022] GET /compute/v2.1/servers/16044770-064c-404f-9a5e-c3c493e8a869 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:47:48.728079 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ed411852-1d2c-493f-bad0-e53f4a42aec7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:48.728692 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ed411852-1d2c-493f-bad0-e53f4a42aec7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:48.734887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ed411852-1d2c-493f-bad0-e53f4a42aec7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:48.735369 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ed411852-1d2c-493f-bad0-e53f4a42aec7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:48.735786 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ed411852-1d2c-493f-bad0-e53f4a42aec7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:48.736462 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ed411852-1d2c-493f-bad0-e53f4a42aec7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:48.736936 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ed411852-1d2c-493f-bad0-e53f4a42aec7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:48.737368 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ed411852-1d2c-493f-bad0-e53f4a42aec7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:48.751138 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-ed411852-1d2c-493f-bad0-e53f4a42aec7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] HTTP exception thrown: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ed411852-1d2c-493f-bad0-e53f4a42aec7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Request method failure captured: Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 HTTP/1.1 Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs4RQ2W0jAEqmIc2a2gyZUln8p5bNCm0_mI8D5F27-XVkP7ATAOu468pXcxlEjqoKhC2riGskVgaopgp2mx1B-_JnDX9K5NgGMMIQuXdxY4mBudlKUObSTI_UiuCCeDA5-u77rF7VJ2ZfC_NCmQ-YCsbSULwwvYBOkysYcpX20qWbNI Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:47:48.752629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:47:48.754344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d04ba57221f42d684873d624dbfd283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:47:48.754344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:48.754344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:48.754344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:48.754344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:48.754344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:47:48.754344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:47:48.754344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 5a0294ea40914bf290902307a787642d Sep 06 04:47:48.754344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:48.754344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:47:48.754344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. Sep 06 04:47:48.754344 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '655e54ca-b46d-40ea-a544-c796990772d7'} Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:47:48.755324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. Sep 06 04:47:48.756894 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:47:48.758529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ed411852-1d2c-493f-bad0-e53f4a42aec7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Returning 404 to user: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:47:48.758529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ed411852-1d2c-493f-bad0-e53f4a42aec7 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "DELETE /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 404 len: 111 microversion: 2.1 time: 0.029896 Sep 06 04:47:48.758529 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 616/1212] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:47:48 2022] DELETE /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:47:48.763220 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-87bc5a8a-1910-4882-b416-eb9012407141 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:47:48.763996 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-87bc5a8a-1910-4882-b416-eb9012407141 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] [instance: 655e54ca-b46d-40ea-a544-c796990772d7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:47:48.770460 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87bc5a8a-1910-4882-b416-eb9012407141 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:48.770932 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87bc5a8a-1910-4882-b416-eb9012407141 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:48.771357 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87bc5a8a-1910-4882-b416-eb9012407141 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:48.772031 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87bc5a8a-1910-4882-b416-eb9012407141 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:47:48.772471 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87bc5a8a-1910-4882-b416-eb9012407141 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:47:48.772925 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-87bc5a8a-1910-4882-b416-eb9012407141 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:47:48.786647 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-87bc5a8a-1910-4882-b416-eb9012407141 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] HTTP exception thrown: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-87bc5a8a-1910-4882-b416-eb9012407141 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Request method failure captured: Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 HTTP/1.1 Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4RQ2W0jAEqmIc2a2gyZUln8p5bNCm0_mI8D5F27-XVkP7ATAOu468pXcxlEjqoKhC2riGskVgaopgp2mx1B-_JnDX9K5NgGMMIQuXdxY4mBudlKUObSTI_UiuCCeDA5-u77rF7VJ2ZfC_NCmQ-YCsbSULwwvYBOkysYcpX20qWbNI Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:47:48.788187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:47:48.789885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_3d04ba57221f42d684873d624dbfd283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/3d04ba57221f42d684873d624dbfd283"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:47:48.789885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:48.789885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 3d04ba57221f42d684873d624dbfd283 Sep 06 04:47:48.789885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1266197729 Sep 06 04:47:48.789885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:48.789885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:47:48.789885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:47:48.789885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 5a0294ea40914bf290902307a787642d Sep 06 04:47:48.789885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeNegativeTest-1266197729-project Sep 06 04:47:48.789885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:47:48.789885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. Sep 06 04:47:48.789885 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '655e54ca-b46d-40ea-a544-c796990772d7'} Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:47:48.791085 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. Sep 06 04:47:48.792618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:47:48.794097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-87bc5a8a-1910-4882-b416-eb9012407141 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] Returning 404 to user: Instance 655e54ca-b46d-40ea-a544-c796990772d7 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:47:48.794097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-87bc5a8a-1910-4882-b416-eb9012407141 tempest-AttachVolumeNegativeTest-1266197729 tempest-AttachVolumeNegativeTest-1266197729-project] 10.222.0.30 "GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7" status: 404 len: 111 microversion: 2.1 time: 0.030915 Sep 06 04:47:48.794097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 597/1213] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:47:48 2022] GET /compute/v2.1/servers/655e54ca-b46d-40ea-a544-c796990772d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:48:06.994045 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d348655e-d3fd-4c0f-a967-df9fde6df2e9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:06.996237 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d348655e-d3fd-4c0f-a967-df9fde6df2e9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:06.999493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=13 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:48:07.000169 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=18 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:48:07.004728 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d348655e-d3fd-4c0f-a967-df9fde6df2e9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:07.005205 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d348655e-d3fd-4c0f-a967-df9fde6df2e9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:07.005665 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d348655e-d3fd-4c0f-a967-df9fde6df2e9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:07.006345 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d348655e-d3fd-4c0f-a967-df9fde6df2e9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:07.006792 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d348655e-d3fd-4c0f-a967-df9fde6df2e9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:07.007212 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d348655e-d3fd-4c0f-a967-df9fde6df2e9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:07.037578 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d348655e-d3fd-4c0f-a967-df9fde6df2e9 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047439 Sep 06 04:48:07.041977 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 617/1214] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Sep 6 04:48:06 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:07.102444 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-73fc44ab-925b-447e-a6a8-27a7e33a2996 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:07.102939 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-73fc44ab-925b-447e-a6a8-27a7e33a2996 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:07.105452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:48:07.106107 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=21 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:48:07.111531 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-73fc44ab-925b-447e-a6a8-27a7e33a2996 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:07.112015 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-73fc44ab-925b-447e-a6a8-27a7e33a2996 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:07.112451 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-73fc44ab-925b-447e-a6a8-27a7e33a2996 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:07.113140 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-73fc44ab-925b-447e-a6a8-27a7e33a2996 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:07.113669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-73fc44ab-925b-447e-a6a8-27a7e33a2996 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:07.114093 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-73fc44ab-925b-447e-a6a8-27a7e33a2996 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:07.140594 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-73fc44ab-925b-447e-a6a8-27a7e33a2996 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:48:07.367683 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-73fc44ab-925b-447e-a6a8-27a7e33a2996 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "DELETE /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 204 len: 0 microversion: 2.20 time: 0.268798 Sep 06 04:48:07.368196 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 598/1215] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Sep 6 04:48:07 2022] DELETE /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 04:48:07.377685 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-91a8690c-2f53-4bdb-9cd8-7e4952bf21f1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:07.378369 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-91a8690c-2f53-4bdb-9cd8-7e4952bf21f1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:07.380486 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 04:48:07.380647 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Tue Sep 6 04:48:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 (ip 10.222.0.30) !!! Sep 06 04:48:07.386876 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91a8690c-2f53-4bdb-9cd8-7e4952bf21f1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:07.387073 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91a8690c-2f53-4bdb-9cd8-7e4952bf21f1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:07.387507 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91a8690c-2f53-4bdb-9cd8-7e4952bf21f1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:07.388374 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91a8690c-2f53-4bdb-9cd8-7e4952bf21f1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:07.388965 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91a8690c-2f53-4bdb-9cd8-7e4952bf21f1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:07.389417 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-91a8690c-2f53-4bdb-9cd8-7e4952bf21f1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:07.531342 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-91a8690c-2f53-4bdb-9cd8-7e4952bf21f1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:07.539738 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-91a8690c-2f53-4bdb-9cd8-7e4952bf21f1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:07.541171 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-91a8690c-2f53-4bdb-9cd8-7e4952bf21f1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:07.542362 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-91a8690c-2f53-4bdb-9cd8-7e4952bf21f1 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1725 microversion: 2.20 time: 0.169947 Sep 06 04:48:07.542907 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 618/1216] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:48:07 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:48:08.574717 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4ef6a31e-b4eb-4da4-b40e-d891a11665bc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:08.574717 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4ef6a31e-b4eb-4da4-b40e-d891a11665bc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:08.579895 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ef6a31e-b4eb-4da4-b40e-d891a11665bc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:08.580381 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ef6a31e-b4eb-4da4-b40e-d891a11665bc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:08.580819 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ef6a31e-b4eb-4da4-b40e-d891a11665bc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:08.581568 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ef6a31e-b4eb-4da4-b40e-d891a11665bc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:08.582021 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ef6a31e-b4eb-4da4-b40e-d891a11665bc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:08.582450 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4ef6a31e-b4eb-4da4-b40e-d891a11665bc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:08.746157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4ef6a31e-b4eb-4da4-b40e-d891a11665bc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:08.754584 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4ef6a31e-b4eb-4da4-b40e-d891a11665bc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:08.757976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4ef6a31e-b4eb-4da4-b40e-d891a11665bc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:08.757976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4ef6a31e-b4eb-4da4-b40e-d891a11665bc tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1725 microversion: 2.20 time: 0.192584 Sep 06 04:48:08.757976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 599/1217] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:48:08 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:48:09.783774 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4a96d7f4-c32b-4d8c-8490-30855e0993ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:09.784376 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4a96d7f4-c32b-4d8c-8490-30855e0993ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:09.793029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a96d7f4-c32b-4d8c-8490-30855e0993ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:09.793593 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a96d7f4-c32b-4d8c-8490-30855e0993ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:09.794697 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a96d7f4-c32b-4d8c-8490-30855e0993ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:09.795402 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a96d7f4-c32b-4d8c-8490-30855e0993ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:09.795886 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a96d7f4-c32b-4d8c-8490-30855e0993ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:09.796338 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4a96d7f4-c32b-4d8c-8490-30855e0993ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:09.889525 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4a96d7f4-c32b-4d8c-8490-30855e0993ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:09.898281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4a96d7f4-c32b-4d8c-8490-30855e0993ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:09.899829 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-4a96d7f4-c32b-4d8c-8490-30855e0993ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:09.900983 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4a96d7f4-c32b-4d8c-8490-30855e0993ad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1657 microversion: 2.20 time: 0.121668 Sep 06 04:48:09.901569 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 619/1218] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:48:09 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1657 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:48:10.116129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-a9a0efa0-fa37-4988-8f4d-9245ec111097 req-7afb0c4f-5d44-40e1-bf0f-b11b4b43cd53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "821737e4-9236-4f80-b1ac-8c4d16c02244", "name": "network-vif-deleted", "tag": "3e4ec09b-2a4b-41e0-871c-50fd282365c6"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:48:10.125915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a9a0efa0-fa37-4988-8f4d-9245ec111097 req-7afb0c4f-5d44-40e1-bf0f-b11b4b43cd53 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:10.128034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a9a0efa0-fa37-4988-8f4d-9245ec111097 req-7afb0c4f-5d44-40e1-bf0f-b11b4b43cd53 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:10.128034 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a9a0efa0-fa37-4988-8f4d-9245ec111097 req-7afb0c4f-5d44-40e1-bf0f-b11b4b43cd53 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:10.138576 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-a9a0efa0-fa37-4988-8f4d-9245ec111097 req-7afb0c4f-5d44-40e1-bf0f-b11b4b43cd53 service nova] Creating event network-vif-deleted:3e4ec09b-2a4b-41e0-871c-50fd282365c6 for instance 821737e4-9236-4f80-b1ac-8c4d16c02244 on hv-cinder-85600 Sep 06 04:48:10.145669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-a9a0efa0-fa37-4988-8f4d-9245ec111097 req-7afb0c4f-5d44-40e1-bf0f-b11b4b43cd53 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033340 Sep 06 04:48:10.146272 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 600/1219] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:48:10.928148 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:10.928755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:10.935548 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:10.936009 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:10.936431 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:10.937105 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:10.937579 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:10.938010 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:10.973111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:10.973709 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:10.974145 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:10.974601 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lazy-loading 'fault' on Instance uuid 821737e4-9236-4f80-b1ac-8c4d16c02244 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:48:11.021887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:11.031141 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:11.032632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1ca147cfc97149dd87e533123a262cfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2388589a34d346f3b31b231a9dafe34d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:11.033835 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-cf8fda4a-552d-4f42-b0ca-388067c52722 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 200 len: 1371 microversion: 2.20 time: 0.109733 Sep 06 04:48:11.034404 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 620/1220] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:48:10 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 06 04:48:12.061010 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-84b675e4-7302-460b-b704-eea39532a5fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:12.061755 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-84b675e4-7302-460b-b704-eea39532a5fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:12.069673 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84b675e4-7302-460b-b704-eea39532a5fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:12.070240 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84b675e4-7302-460b-b704-eea39532a5fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:12.070589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84b675e4-7302-460b-b704-eea39532a5fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:12.071285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84b675e4-7302-460b-b704-eea39532a5fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:12.071732 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84b675e4-7302-460b-b704-eea39532a5fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:12.072331 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-84b675e4-7302-460b-b704-eea39532a5fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:12.086797 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-84b675e4-7302-460b-b704-eea39532a5fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] HTTP exception thrown: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-84b675e4-7302-460b-b704-eea39532a5fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Request method failure captured: Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 HTTP/1.1 Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4TMaQH41LYRJ4gx3sHLOhuJ8Ig4melyVWFfJGGJH_dZ9qGVDO-gwJMBB5z4fPFWkE5u6eznYLGcJrTN4UFVMiBfsCEVFM2kyY0_TLVdZxQ4fnVaF-fOgVIapjtC4qm53UhbdWZN_KgLpD3Nn5p8Y4ELqZU7F19HEEeBvVvFoHqXQs Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 2388589a34d346f3b31b231a9dafe34d Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:48:12.088667 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:48:12.090484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:48:12.090484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:48:12.090484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 2388589a34d346f3b31b231a9dafe34d Sep 06 04:48:12.090484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:48:12.090484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeShelveTestJSON-727986358-project Sep 06 04:48:12.090484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:48:12.090484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:48:12.090484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 1ca147cfc97149dd87e533123a262cfd Sep 06 04:48:12.090484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-727986358-project Sep 06 04:48:12.090484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:48:12.090484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. Sep 06 04:48:12.090484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '821737e4-9236-4f80-b1ac-8c4d16c02244'} Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:48:12.092596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. Sep 06 04:48:12.094442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:12.096686 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-84b675e4-7302-460b-b704-eea39532a5fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Returning 404 to user: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:48:12.096686 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-84b675e4-7302-460b-b704-eea39532a5fa tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 404 len: 111 microversion: 2.20 time: 0.034783 Sep 06 04:48:12.096686 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 601/1221] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:48:12 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 04:48:12.102815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0d446e35-b8ef-4c6e-9046-143da5580cad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '.version_select at 0x7f3176710700>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:12.164262 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0d446e35-b8ef-4c6e-9046-143da5580cad tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-373883510" status: 204 len: 0 microversion: 2.20 time: 0.065495 Sep 06 04:48:12.164846 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 621/1222] 10.222.0.30 () {60 vars in 1259 bytes} [Tue Sep 6 04:48:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-373883510 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 06 04:48:14.251940 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bb02a918-b6ee-4cb4-a761-fbcc676644c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:14.252492 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bb02a918-b6ee-4cb4-a761-fbcc676644c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:14.258621 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb02a918-b6ee-4cb4-a761-fbcc676644c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:14.259175 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb02a918-b6ee-4cb4-a761-fbcc676644c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:14.259707 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb02a918-b6ee-4cb4-a761-fbcc676644c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:14.260468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb02a918-b6ee-4cb4-a761-fbcc676644c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:14.260992 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb02a918-b6ee-4cb4-a761-fbcc676644c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:14.261483 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bb02a918-b6ee-4cb4-a761-fbcc676644c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:14.275524 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-bb02a918-b6ee-4cb4-a761-fbcc676644c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] HTTP exception thrown: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bb02a918-b6ee-4cb4-a761-fbcc676644c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Request method failure captured: Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 HTTP/1.1 Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4TMaQH41LYRJ4gx3sHLOhuJ8Ig4melyVWFfJGGJH_dZ9qGVDO-gwJMBB5z4fPFWkE5u6eznYLGcJrTN4UFVMiBfsCEVFM2kyY0_TLVdZxQ4fnVaF-fOgVIapjtC4qm53UhbdWZN_KgLpD3Nn5p8Y4ELqZU7F19HEEeBvVvFoHqXQs Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 2388589a34d346f3b31b231a9dafe34d Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:48:14.277129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:48:14.279401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:48:14.279401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:48:14.279401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 2388589a34d346f3b31b231a9dafe34d Sep 06 04:48:14.279401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:48:14.279401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeShelveTestJSON-727986358-project Sep 06 04:48:14.279401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:48:14.279401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:48:14.279401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 1ca147cfc97149dd87e533123a262cfd Sep 06 04:48:14.279401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-727986358-project Sep 06 04:48:14.279401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:48:14.279401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. Sep 06 04:48:14.279401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '821737e4-9236-4f80-b1ac-8c4d16c02244'} Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:48:14.280241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. Sep 06 04:48:14.281979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:14.283363 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bb02a918-b6ee-4cb4-a761-fbcc676644c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Returning 404 to user: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:48:14.283363 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bb02a918-b6ee-4cb4-a761-fbcc676644c4 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "DELETE /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 404 len: 111 microversion: 2.20 time: 0.031298 Sep 06 04:48:14.283363 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 602/1223] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Sep 6 04:48:14 2022] DELETE /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 04:48:14.289066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-22a26be1-aa6b-4b6e-9c0d-dac3a9e6ec8d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:14.289699 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-22a26be1-aa6b-4b6e-9c0d-dac3a9e6ec8d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 821737e4-9236-4f80-b1ac-8c4d16c02244] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:14.296270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22a26be1-aa6b-4b6e-9c0d-dac3a9e6ec8d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:14.296789 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22a26be1-aa6b-4b6e-9c0d-dac3a9e6ec8d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:14.297222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22a26be1-aa6b-4b6e-9c0d-dac3a9e6ec8d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:14.297938 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22a26be1-aa6b-4b6e-9c0d-dac3a9e6ec8d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:14.298391 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22a26be1-aa6b-4b6e-9c0d-dac3a9e6ec8d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:14.298811 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-22a26be1-aa6b-4b6e-9c0d-dac3a9e6ec8d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:14.311816 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-22a26be1-aa6b-4b6e-9c0d-dac3a9e6ec8d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] HTTP exception thrown: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-22a26be1-aa6b-4b6e-9c0d-dac3a9e6ec8d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Request method failure captured: Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 HTTP/1.1 Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs4TMaQH41LYRJ4gx3sHLOhuJ8Ig4melyVWFfJGGJH_dZ9qGVDO-gwJMBB5z4fPFWkE5u6eznYLGcJrTN4UFVMiBfsCEVFM2kyY0_TLVdZxQ4fnVaF-fOgVIapjtC4qm53UhbdWZN_KgLpD3Nn5p8Y4ELqZU7F19HEEeBvVvFoHqXQs Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 2388589a34d346f3b31b231a9dafe34d Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:48:14.313364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:48:14.315276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:48:14.315276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:48:14.315276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 2388589a34d346f3b31b231a9dafe34d Sep 06 04:48:14.315276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:48:14.315276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeShelveTestJSON-727986358-project Sep 06 04:48:14.315276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:48:14.315276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:48:14.315276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 1ca147cfc97149dd87e533123a262cfd Sep 06 04:48:14.315276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeShelveTestJSON-727986358-project Sep 06 04:48:14.315276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:48:14.315276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. Sep 06 04:48:14.315276 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '821737e4-9236-4f80-b1ac-8c4d16c02244'} Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:48:14.316444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. Sep 06 04:48:14.318222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:14.319638 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-22a26be1-aa6b-4b6e-9c0d-dac3a9e6ec8d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Returning 404 to user: Instance 821737e4-9236-4f80-b1ac-8c4d16c02244 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:48:14.319638 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-22a26be1-aa6b-4b6e-9c0d-dac3a9e6ec8d tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244" status: 404 len: 111 microversion: 2.20 time: 0.030023 Sep 06 04:48:14.319638 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 622/1224] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:48:14 2022] GET /compute/v2.1/servers/821737e4-9236-4f80-b1ac-8c4d16c02244 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 04:48:15.570999 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7a03e6a8-30ea-413c-921b-270880432d87 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:15.571515 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7a03e6a8-30ea-413c-921b-270880432d87 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:15.578066 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a03e6a8-30ea-413c-921b-270880432d87 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:15.578546 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a03e6a8-30ea-413c-921b-270880432d87 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:15.578974 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a03e6a8-30ea-413c-921b-270880432d87 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:15.579663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a03e6a8-30ea-413c-921b-270880432d87 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:15.580118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a03e6a8-30ea-413c-921b-270880432d87 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:15.580541 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7a03e6a8-30ea-413c-921b-270880432d87 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:15.594967 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-7a03e6a8-30ea-413c-921b-270880432d87 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] HTTP exception thrown: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7a03e6a8-30ea-413c-921b-270880432d87 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Request method failure captured: Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 HTTP/1.1 Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs4TMaQH41LYRJ4gx3sHLOhuJ8Ig4melyVWFfJGGJH_dZ9qGVDO-gwJMBB5z4fPFWkE5u6eznYLGcJrTN4UFVMiBfsCEVFM2kyY0_TLVdZxQ4fnVaF-fOgVIapjtC4qm53UhbdWZN_KgLpD3Nn5p8Y4ELqZU7F19HEEeBvVvFoHqXQs Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 2388589a34d346f3b31b231a9dafe34d Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:48:15.596507 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:48:15.598369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:48:15.598369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:48:15.598369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 2388589a34d346f3b31b231a9dafe34d Sep 06 04:48:15.598369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:48:15.598369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeShelveTestJSON-727986358-project Sep 06 04:48:15.598369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:48:15.598369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:48:15.598369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 1ca147cfc97149dd87e533123a262cfd Sep 06 04:48:15.598369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeShelveTestJSON-727986358-project Sep 06 04:48:15.598369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:48:15.598369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. Sep 06 04:48:15.598369 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '53238a8f-2601-4952-acd2-4dcb02761c12'} Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:48:15.599324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. Sep 06 04:48:15.600829 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:15.602668 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7a03e6a8-30ea-413c-921b-270880432d87 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Returning 404 to user: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:48:15.602668 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7a03e6a8-30ea-413c-921b-270880432d87 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "DELETE /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 404 len: 111 microversion: 2.20 time: 0.031705 Sep 06 04:48:15.602668 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 603/1225] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Sep 6 04:48:15 2022] DELETE /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 06 04:48:15.609528 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5dc7da38-f432-42f3-a2d0-747fe8c3c0d0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:15.610330 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5dc7da38-f432-42f3-a2d0-747fe8c3c0d0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] [instance: 53238a8f-2601-4952-acd2-4dcb02761c12] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:15.616783 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5dc7da38-f432-42f3-a2d0-747fe8c3c0d0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:15.617266 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5dc7da38-f432-42f3-a2d0-747fe8c3c0d0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:15.617785 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5dc7da38-f432-42f3-a2d0-747fe8c3c0d0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:15.618470 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5dc7da38-f432-42f3-a2d0-747fe8c3c0d0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:15.619048 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5dc7da38-f432-42f3-a2d0-747fe8c3c0d0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:15.619473 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5dc7da38-f432-42f3-a2d0-747fe8c3c0d0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:15.633041 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-5dc7da38-f432-42f3-a2d0-747fe8c3c0d0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] HTTP exception thrown: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5dc7da38-f432-42f3-a2d0-747fe8c3c0d0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Request method failure captured: Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 HTTP/1.1 Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs4TMaQH41LYRJ4gx3sHLOhuJ8Ig4melyVWFfJGGJH_dZ9qGVDO-gwJMBB5z4fPFWkE5u6eznYLGcJrTN4UFVMiBfsCEVFM2kyY0_TLVdZxQ4fnVaF-fOgVIapjtC4qm53UhbdWZN_KgLpD3Nn5p8Y4ELqZU7F19HEEeBvVvFoHqXQs Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Openstack-Nova-Api-Version: 2.20 Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 2388589a34d346f3b31b231a9dafe34d Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:48:15.634691 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:48:15.640970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/2388589a34d346f3b31b231a9dafe34d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:48:15.640970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:48:15.640970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 2388589a34d346f3b31b231a9dafe34d Sep 06 04:48:15.640970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-727986358 Sep 06 04:48:15.640970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeShelveTestJSON-727986358-project Sep 06 04:48:15.640970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:48:15.640970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:48:15.640970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 1ca147cfc97149dd87e533123a262cfd Sep 06 04:48:15.640970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeShelveTestJSON-727986358-project Sep 06 04:48:15.640970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:48:15.640970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. Sep 06 04:48:15.640970 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '53238a8f-2601-4952-acd2-4dcb02761c12'} Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:48:15.641973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. Sep 06 04:48:15.643632 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:15.645022 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5dc7da38-f432-42f3-a2d0-747fe8c3c0d0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] Returning 404 to user: Instance 53238a8f-2601-4952-acd2-4dcb02761c12 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:48:15.645022 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5dc7da38-f432-42f3-a2d0-747fe8c3c0d0 tempest-AttachVolumeShelveTestJSON-727986358 tempest-AttachVolumeShelveTestJSON-727986358-project] 10.222.0.30 "GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12" status: 404 len: 111 microversion: 2.20 time: 0.030508 Sep 06 04:48:15.645022 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 623/1226] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Sep 6 04:48:15 2022] GET /compute/v2.1/servers/53238a8f-2601-4952-acd2-4dcb02761c12 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 06 04:48:26.672482 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:48:26.673470 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:48:26.818129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9a2f7063-38c7-4951-9d79-cda81ec674cc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Action: 'create', calling method: .version_select at 0x7f3176452c10>, body: {"keypair": {"name": "tempest-keypair-1495182289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtZrnF9cVTSKQCkreBUAMTspnqjZM9vxCZiuoKnlbo7fSudCG034/Cpvx79azllZyHvg8uzWB4WeDg3smLOnEMhaXXjotbuMOBRIyLK9iSUfUWD4pb2XKs7GL0NNlUA/Q=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:48:26.834565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-9a2f7063-38c7-4951-9d79-cda81ec674cc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Getting quotas for project f91efa94deff4ceb80b0a1aa88087421. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:48:26.838554 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-9a2f7063-38c7-4951-9d79-cda81ec674cc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Getting quotas for user 31b919a031504f2bace596da457b91cf and project f91efa94deff4ceb80b0a1aa88087421. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:48:26.922430 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9a2f7063-38c7-4951-9d79-cda81ec674cc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.254376 Sep 06 04:48:26.931285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 604/1227] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Sep 6 04:48:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:48:29.560290 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1356837659", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d940072-d3c6-4a12-b0c8-5039fce3aa0d"}], "security_groups": [{"name": "tempest-securitygroup--2007582722"}], "key_name": "tempest-keypair-1495182289", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:48:29.575974 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:48:29.576644 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=30 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:48:29.695228 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] validate_networks() for [('3d940072-d3c6-4a12-b0c8-5039fce3aa0d', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:48:30.327229 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:48:30.327711 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:48:30.328271 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:48:30.328746 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:48:30.329398 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:48:30.338775 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:30.339545 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:30.340048 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:30.340852 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:30.341402 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:30.342056 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:30.361249 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Getting quotas for project f91efa94deff4ceb80b0a1aa88087421. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:48:30.365836 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Getting quotas for user 31b919a031504f2bace596da457b91cf and project f91efa94deff4ceb80b0a1aa88087421. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:48:30.379443 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:48:30.382147 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:48:30.581985 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-87f11412-f904-4145-b1cb-2769a3b10903 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.026193 Sep 06 04:48:30.582812 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 624/1228] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:48:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:48:30.594998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5c26fcac-b304-4712-ad35-e1a9fed817f4 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:30.596614 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5c26fcac-b304-4712-ad35-e1a9fed817f4 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:30.657448 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5c26fcac-b304-4712-ad35-e1a9fed817f4 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:30.665349 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5c26fcac-b304-4712-ad35-e1a9fed817f4 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1238 microversion: 2.1 time: 0.074678 Sep 06 04:48:30.665912 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 605/1229] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:30 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:31.691663 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bb69c4d1-a1df-4e2f-9ef5-b9c503e42c8b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:31.692235 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bb69c4d1-a1df-4e2f-9ef5-b9c503e42c8b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:31.699113 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb69c4d1-a1df-4e2f-9ef5-b9c503e42c8b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:31.706131 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb69c4d1-a1df-4e2f-9ef5-b9c503e42c8b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:31.706131 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb69c4d1-a1df-4e2f-9ef5-b9c503e42c8b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:31.706131 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb69c4d1-a1df-4e2f-9ef5-b9c503e42c8b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:31.706131 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb69c4d1-a1df-4e2f-9ef5-b9c503e42c8b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:31.706534 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb69c4d1-a1df-4e2f-9ef5-b9c503e42c8b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:31.769772 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bb69c4d1-a1df-4e2f-9ef5-b9c503e42c8b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:31.778501 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bb69c4d1-a1df-4e2f-9ef5-b9c503e42c8b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1242 microversion: 2.1 time: 0.092298 Sep 06 04:48:31.779069 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 625/1230] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:31 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1242 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:32.803460 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-fc5f7782-96a4-43f5-b528-5dd56a370d03 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:32.804070 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-fc5f7782-96a4-43f5-b528-5dd56a370d03 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:32.812262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc5f7782-96a4-43f5-b528-5dd56a370d03 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:32.812788 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc5f7782-96a4-43f5-b528-5dd56a370d03 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:32.813251 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc5f7782-96a4-43f5-b528-5dd56a370d03 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:32.813951 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc5f7782-96a4-43f5-b528-5dd56a370d03 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:32.814412 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc5f7782-96a4-43f5-b528-5dd56a370d03 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:32.814836 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-fc5f7782-96a4-43f5-b528-5dd56a370d03 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:32.879210 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-fc5f7782-96a4-43f5-b528-5dd56a370d03 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:32.886184 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-fc5f7782-96a4-43f5-b528-5dd56a370d03 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1290 microversion: 2.1 time: 0.087305 Sep 06 04:48:32.886764 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 606/1231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:32 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1290 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:33.909205 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c589c369-73ed-4e81-9e15-fc772116b296 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:33.909952 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c589c369-73ed-4e81-9e15-fc772116b296 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:33.916705 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c589c369-73ed-4e81-9e15-fc772116b296 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:33.917539 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c589c369-73ed-4e81-9e15-fc772116b296 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:33.917973 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c589c369-73ed-4e81-9e15-fc772116b296 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:33.918784 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c589c369-73ed-4e81-9e15-fc772116b296 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:33.919326 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c589c369-73ed-4e81-9e15-fc772116b296 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:33.919799 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c589c369-73ed-4e81-9e15-fc772116b296 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:34.121680 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c589c369-73ed-4e81-9e15-fc772116b296 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:34.131145 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c589c369-73ed-4e81-9e15-fc772116b296 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1364 microversion: 2.1 time: 0.226333 Sep 06 04:48:34.137829 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 626/1232] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:33 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:34.933152 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-a334ab51-449b-465c-9681-451b34298439 req-7fee2e5f-fdc9-494f-898d-0bf99eb13470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1fe518-288a-42d5-a385-829581568441", "tag": "f3db9658-18de-42f4-8b9e-69f7017c0392"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:48:34.946548 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a334ab51-449b-465c-9681-451b34298439 req-7fee2e5f-fdc9-494f-898d-0bf99eb13470 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:34.947439 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a334ab51-449b-465c-9681-451b34298439 req-7fee2e5f-fdc9-494f-898d-0bf99eb13470 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:34.947927 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a334ab51-449b-465c-9681-451b34298439 req-7fee2e5f-fdc9-494f-898d-0bf99eb13470 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:34.963045 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-a334ab51-449b-465c-9681-451b34298439 req-7fee2e5f-fdc9-494f-898d-0bf99eb13470 service nova] Creating event network-changed:f3db9658-18de-42f4-8b9e-69f7017c0392 for instance 1b1fe518-288a-42d5-a385-829581568441 on hv-cinder-85600 Sep 06 04:48:34.968307 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-a334ab51-449b-465c-9681-451b34298439 req-7fee2e5f-fdc9-494f-898d-0bf99eb13470 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038975 Sep 06 04:48:34.968913 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 607/1233] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:48:35.132719 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ae3bd09f-e7d7-4fcd-8501-6ad228179db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:35.134029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ae3bd09f-e7d7-4fcd-8501-6ad228179db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:35.139506 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-723f10fb-e728-471d-9bcb-14ac48c981ee req-afc65d8b-e146-4cf7-abc6-43410ac4262e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17758d6d-93d6-48b1-890f-eca1a0fe0058", "tag": "0f636c18-fb41-4c1e-b52b-868f0f44b336"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:48:35.146034 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae3bd09f-e7d7-4fcd-8501-6ad228179db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:35.148180 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae3bd09f-e7d7-4fcd-8501-6ad228179db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:35.148180 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae3bd09f-e7d7-4fcd-8501-6ad228179db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:35.148180 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae3bd09f-e7d7-4fcd-8501-6ad228179db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:35.149917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-723f10fb-e728-471d-9bcb-14ac48c981ee req-afc65d8b-e146-4cf7-abc6-43410ac4262e service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:35.150391 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-723f10fb-e728-471d-9bcb-14ac48c981ee req-afc65d8b-e146-4cf7-abc6-43410ac4262e service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:35.150816 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-723f10fb-e728-471d-9bcb-14ac48c981ee req-afc65d8b-e146-4cf7-abc6-43410ac4262e service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:35.151213 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae3bd09f-e7d7-4fcd-8501-6ad228179db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:35.154018 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ae3bd09f-e7d7-4fcd-8501-6ad228179db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:35.165747 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-723f10fb-e728-471d-9bcb-14ac48c981ee req-afc65d8b-e146-4cf7-abc6-43410ac4262e service nova] Creating event network-changed:0f636c18-fb41-4c1e-b52b-868f0f44b336 for instance 17758d6d-93d6-48b1-890f-eca1a0fe0058 on hv-cinder-85600 Sep 06 04:48:35.173557 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-723f10fb-e728-471d-9bcb-14ac48c981ee req-afc65d8b-e146-4cf7-abc6-43410ac4262e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037145 Sep 06 04:48:35.174440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 608/1234] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:48:35.181845 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cae9a319-c95d-4926-9763-def6adbc8ab9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:35.184129 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cae9a319-c95d-4926-9763-def6adbc8ab9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:35.185172 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ae3bd09f-e7d7-4fcd-8501-6ad228179db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:48:35.190853 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cae9a319-c95d-4926-9763-def6adbc8ab9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:35.191349 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cae9a319-c95d-4926-9763-def6adbc8ab9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:35.191789 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cae9a319-c95d-4926-9763-def6adbc8ab9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:35.192485 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cae9a319-c95d-4926-9763-def6adbc8ab9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:35.192937 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cae9a319-c95d-4926-9763-def6adbc8ab9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:35.193386 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cae9a319-c95d-4926-9763-def6adbc8ab9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:35.463699 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-cae9a319-c95d-4926-9763-def6adbc8ab9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:35.478401 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cae9a319-c95d-4926-9763-def6adbc8ab9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1364 microversion: 2.1 time: 0.300268 Sep 06 04:48:35.480510 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 609/1235] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:35 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:35.564308 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ae3bd09f-e7d7-4fcd-8501-6ad228179db5 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "DELETE /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 204 len: 0 microversion: 2.1 time: 0.436052 Sep 06 04:48:35.564892 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 627/1236] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:48:35 2022] DELETE /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:48:35.573207 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f27bf1a5-eed0-438d-8f76-106cd196c22c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:35.573853 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f27bf1a5-eed0-438d-8f76-106cd196c22c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:35.580729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f27bf1a5-eed0-438d-8f76-106cd196c22c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:35.581277 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f27bf1a5-eed0-438d-8f76-106cd196c22c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:35.581669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f27bf1a5-eed0-438d-8f76-106cd196c22c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:35.582363 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f27bf1a5-eed0-438d-8f76-106cd196c22c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:35.582814 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f27bf1a5-eed0-438d-8f76-106cd196c22c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:35.585553 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f27bf1a5-eed0-438d-8f76-106cd196c22c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:35.727542 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f27bf1a5-eed0-438d-8f76-106cd196c22c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:35.735805 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f27bf1a5-eed0-438d-8f76-106cd196c22c tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1576 microversion: 2.1 time: 0.166428 Sep 06 04:48:35.736372 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 610/1237] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:35 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:36.503484 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1ab70f38-805b-4fc6-ad50-8d62fdf0b45e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:36.504180 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1ab70f38-805b-4fc6-ad50-8d62fdf0b45e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:36.510715 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ab70f38-805b-4fc6-ad50-8d62fdf0b45e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:36.511185 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ab70f38-805b-4fc6-ad50-8d62fdf0b45e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:36.511619 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ab70f38-805b-4fc6-ad50-8d62fdf0b45e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:36.512339 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ab70f38-805b-4fc6-ad50-8d62fdf0b45e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:36.512792 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ab70f38-805b-4fc6-ad50-8d62fdf0b45e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:36.513209 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1ab70f38-805b-4fc6-ad50-8d62fdf0b45e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:36.656351 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1ab70f38-805b-4fc6-ad50-8d62fdf0b45e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:36.665360 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1ab70f38-805b-4fc6-ad50-8d62fdf0b45e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1364 microversion: 2.1 time: 0.166749 Sep 06 04:48:36.666018 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 628/1238] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:36 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:36.759717 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2216773f-783d-41f9-bb10-342f4c5a2156 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:36.760418 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2216773f-783d-41f9-bb10-342f4c5a2156 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:36.767409 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2216773f-783d-41f9-bb10-342f4c5a2156 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:36.768121 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2216773f-783d-41f9-bb10-342f4c5a2156 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:36.768554 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2216773f-783d-41f9-bb10-342f4c5a2156 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:36.769692 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2216773f-783d-41f9-bb10-342f4c5a2156 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:36.770144 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2216773f-783d-41f9-bb10-342f4c5a2156 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:36.770561 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2216773f-783d-41f9-bb10-342f4c5a2156 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:37.037068 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-2216773f-783d-41f9-bb10-342f4c5a2156 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:37.044739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2216773f-783d-41f9-bb10-342f4c5a2156 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1576 microversion: 2.1 time: 0.289179 Sep 06 04:48:37.046676 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 611/1239] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:36 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1576 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:37.692150 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-778cafce-16ff-4219-a9c1-461fecda51fd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:37.692755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-778cafce-16ff-4219-a9c1-461fecda51fd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:37.698887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-778cafce-16ff-4219-a9c1-461fecda51fd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:37.703073 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-778cafce-16ff-4219-a9c1-461fecda51fd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:37.703073 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-778cafce-16ff-4219-a9c1-461fecda51fd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:37.703073 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-778cafce-16ff-4219-a9c1-461fecda51fd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:37.703073 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-778cafce-16ff-4219-a9c1-461fecda51fd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:37.703739 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-778cafce-16ff-4219-a9c1-461fecda51fd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:37.835871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-778cafce-16ff-4219-a9c1-461fecda51fd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:37.844433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-778cafce-16ff-4219-a9c1-461fecda51fd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1364 microversion: 2.1 time: 0.156334 Sep 06 04:48:37.844989 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 629/1240] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:37 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:38.069720 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1d393128-c5f0-42e1-8ee9-ebf640b5db6b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:38.070323 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1d393128-c5f0-42e1-8ee9-ebf640b5db6b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:38.076736 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d393128-c5f0-42e1-8ee9-ebf640b5db6b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:38.077241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d393128-c5f0-42e1-8ee9-ebf640b5db6b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:38.077701 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d393128-c5f0-42e1-8ee9-ebf640b5db6b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:38.078380 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d393128-c5f0-42e1-8ee9-ebf640b5db6b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:38.078822 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d393128-c5f0-42e1-8ee9-ebf640b5db6b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:38.079235 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1d393128-c5f0-42e1-8ee9-ebf640b5db6b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:38.212656 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1d393128-c5f0-42e1-8ee9-ebf640b5db6b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:38.220809 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1d393128-c5f0-42e1-8ee9-ebf640b5db6b tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1576 microversion: 2.1 time: 0.154903 Sep 06 04:48:38.221384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 612/1241] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:38 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:38.866909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-be451854-5cd7-4402-808c-6485c2fa8abd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:38.867515 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-be451854-5cd7-4402-808c-6485c2fa8abd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:38.873850 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be451854-5cd7-4402-808c-6485c2fa8abd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:38.874331 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be451854-5cd7-4402-808c-6485c2fa8abd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:38.874763 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be451854-5cd7-4402-808c-6485c2fa8abd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:38.875440 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be451854-5cd7-4402-808c-6485c2fa8abd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:38.875889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be451854-5cd7-4402-808c-6485c2fa8abd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:38.876308 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be451854-5cd7-4402-808c-6485c2fa8abd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:39.007197 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-be451854-5cd7-4402-808c-6485c2fa8abd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:39.015267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-be451854-5cd7-4402-808c-6485c2fa8abd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1364 microversion: 2.1 time: 0.152202 Sep 06 04:48:39.015844 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 630/1242] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:38 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:39.244049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-9765baea-a8d0-4783-a4a6-7906539194da tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:39.244679 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-9765baea-a8d0-4783-a4a6-7906539194da tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:39.251698 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9765baea-a8d0-4783-a4a6-7906539194da tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:39.252185 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9765baea-a8d0-4783-a4a6-7906539194da tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:39.252629 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9765baea-a8d0-4783-a4a6-7906539194da tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:39.253298 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9765baea-a8d0-4783-a4a6-7906539194da tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:39.253767 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9765baea-a8d0-4783-a4a6-7906539194da tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:39.254183 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-9765baea-a8d0-4783-a4a6-7906539194da tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:39.398430 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-9765baea-a8d0-4783-a4a6-7906539194da tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:39.407148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-9765baea-a8d0-4783-a4a6-7906539194da tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1576 microversion: 2.1 time: 0.166919 Sep 06 04:48:39.407901 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 613/1243] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:39 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:40.039776 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a82a8cc3-6b8b-486d-a689-0a7875776151 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:40.040661 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a82a8cc3-6b8b-486d-a689-0a7875776151 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:40.048979 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a82a8cc3-6b8b-486d-a689-0a7875776151 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:40.049692 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a82a8cc3-6b8b-486d-a689-0a7875776151 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:40.050291 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a82a8cc3-6b8b-486d-a689-0a7875776151 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:40.051141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a82a8cc3-6b8b-486d-a689-0a7875776151 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:40.052442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a82a8cc3-6b8b-486d-a689-0a7875776151 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:40.056106 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a82a8cc3-6b8b-486d-a689-0a7875776151 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:40.222474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-9213a978-6ea5-428d-9bee-9c3e8793cc55 req-5afb76e3-4c79-4185-b773-2a07cae73faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17758d6d-93d6-48b1-890f-eca1a0fe0058", "name": "network-vif-unplugged", "status": "completed", "tag": "0f636c18-fb41-4c1e-b52b-868f0f44b336"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:48:40.249361 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9213a978-6ea5-428d-9bee-9c3e8793cc55 req-5afb76e3-4c79-4185-b773-2a07cae73faf service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:40.250195 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9213a978-6ea5-428d-9bee-9c3e8793cc55 req-5afb76e3-4c79-4185-b773-2a07cae73faf service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:40.252093 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-9213a978-6ea5-428d-9bee-9c3e8793cc55 req-5afb76e3-4c79-4185-b773-2a07cae73faf service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:40.262444 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-9213a978-6ea5-428d-9bee-9c3e8793cc55 req-5afb76e3-4c79-4185-b773-2a07cae73faf service nova] Creating event network-vif-unplugged:0f636c18-fb41-4c1e-b52b-868f0f44b336 for instance 17758d6d-93d6-48b1-890f-eca1a0fe0058 on hv-cinder-85600 Sep 06 04:48:40.269837 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a82a8cc3-6b8b-486d-a689-0a7875776151 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:40.278462 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a82a8cc3-6b8b-486d-a689-0a7875776151 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1364 microversion: 2.1 time: 0.242548 Sep 06 04:48:40.282899 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-9213a978-6ea5-428d-9bee-9c3e8793cc55 req-5afb76e3-4c79-4185-b773-2a07cae73faf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.319561 Sep 06 04:48:40.283313 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 614/1244] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:40 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1364 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:40.283511 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 631/1245] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:48:40.403221 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-87b16f70-7807-4c54-a2eb-0ae1fbf9cd87 req-4653a7de-d3bb-41d1-ad53-43f1b33b60e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17758d6d-93d6-48b1-890f-eca1a0fe0058", "name": "network-vif-deleted", "tag": "0f636c18-fb41-4c1e-b52b-868f0f44b336"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:48:40.413646 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-87b16f70-7807-4c54-a2eb-0ae1fbf9cd87 req-4653a7de-d3bb-41d1-ad53-43f1b33b60e8 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:40.414141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-87b16f70-7807-4c54-a2eb-0ae1fbf9cd87 req-4653a7de-d3bb-41d1-ad53-43f1b33b60e8 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:40.414603 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-87b16f70-7807-4c54-a2eb-0ae1fbf9cd87 req-4653a7de-d3bb-41d1-ad53-43f1b33b60e8 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:40.428504 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-87b16f70-7807-4c54-a2eb-0ae1fbf9cd87 req-4653a7de-d3bb-41d1-ad53-43f1b33b60e8 service nova] Creating event network-vif-deleted:0f636c18-fb41-4c1e-b52b-868f0f44b336 for instance 17758d6d-93d6-48b1-890f-eca1a0fe0058 on hv-cinder-85600 Sep 06 04:48:40.431829 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:48:40.431829 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:48:40.433646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b1e30ec6-8647-42d2-8abc-55074fce96e3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:40.433774 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-87b16f70-7807-4c54-a2eb-0ae1fbf9cd87 req-4653a7de-d3bb-41d1-ad53-43f1b33b60e8 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036144 Sep 06 04:48:40.434306 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 615/1246] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:48:40.434480 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b1e30ec6-8647-42d2-8abc-55074fce96e3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:40.440629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1e30ec6-8647-42d2-8abc-55074fce96e3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:40.441114 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1e30ec6-8647-42d2-8abc-55074fce96e3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:40.441588 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1e30ec6-8647-42d2-8abc-55074fce96e3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:40.442312 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1e30ec6-8647-42d2-8abc-55074fce96e3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:40.442766 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1e30ec6-8647-42d2-8abc-55074fce96e3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:40.443191 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b1e30ec6-8647-42d2-8abc-55074fce96e3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:40.520399 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b1e30ec6-8647-42d2-8abc-55074fce96e3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:40.527596 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b1e30ec6-8647-42d2-8abc-55074fce96e3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1390 microversion: 2.1 time: 0.099995 Sep 06 04:48:40.528198 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 632/1247] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:40 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1390 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:48:41.317072 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b1cba34b-cd53-42c3-9080-1461dbb151ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:41.319229 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b1cba34b-cd53-42c3-9080-1461dbb151ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:41.331551 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:48:41.331551 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1cba34b-cd53-42c3-9080-1461dbb151ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:41.333167 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1cba34b-cd53-42c3-9080-1461dbb151ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:41.333648 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1cba34b-cd53-42c3-9080-1461dbb151ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:41.334416 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1cba34b-cd53-42c3-9080-1461dbb151ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:41.335043 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1cba34b-cd53-42c3-9080-1461dbb151ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:41.335627 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b1cba34b-cd53-42c3-9080-1461dbb151ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:41.509481 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b1cba34b-cd53-42c3-9080-1461dbb151ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:41.517679 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b1cba34b-cd53-42c3-9080-1461dbb151ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1364 microversion: 2.1 time: 0.207150 Sep 06 04:48:41.518283 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 616/1248] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:41 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:41.553468 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-bb131bd8-80f4-421f-969f-4962cd1f8778 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:41.554102 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-bb131bd8-80f4-421f-969f-4962cd1f8778 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:41.560918 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb131bd8-80f4-421f-969f-4962cd1f8778 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:41.561436 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb131bd8-80f4-421f-969f-4962cd1f8778 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:41.561875 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb131bd8-80f4-421f-969f-4962cd1f8778 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:41.563896 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb131bd8-80f4-421f-969f-4962cd1f8778 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:41.564382 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb131bd8-80f4-421f-969f-4962cd1f8778 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:41.564807 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb131bd8-80f4-421f-969f-4962cd1f8778 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:41.597936 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb131bd8-80f4-421f-969f-4962cd1f8778 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:41.598778 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb131bd8-80f4-421f-969f-4962cd1f8778 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:41.598910 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-bb131bd8-80f4-421f-969f-4962cd1f8778 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:41.599342 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-bb131bd8-80f4-421f-969f-4962cd1f8778 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lazy-loading 'fault' on Instance uuid 17758d6d-93d6-48b1-890f-eca1a0fe0058 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:48:41.646653 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-bb131bd8-80f4-421f-969f-4962cd1f8778 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:41.657057 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-bb131bd8-80f4-421f-969f-4962cd1f8778 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 200 len: 1229 microversion: 2.1 time: 0.107888 Sep 06 04:48:41.657682 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 633/1249] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:41 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 1229 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:42.307680 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-d1b4cb4e-71de-4b59-9c77-9008507827a9 req-640619f6-d978-444f-8af3-5d0fbceb1289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1fe518-288a-42d5-a385-829581568441", "name": "network-vif-plugged", "status": "completed", "tag": "f3db9658-18de-42f4-8b9e-69f7017c0392"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:48:42.322436 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d1b4cb4e-71de-4b59-9c77-9008507827a9 req-640619f6-d978-444f-8af3-5d0fbceb1289 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:42.323102 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d1b4cb4e-71de-4b59-9c77-9008507827a9 req-640619f6-d978-444f-8af3-5d0fbceb1289 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:42.323346 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-d1b4cb4e-71de-4b59-9c77-9008507827a9 req-640619f6-d978-444f-8af3-5d0fbceb1289 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:42.334724 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-d1b4cb4e-71de-4b59-9c77-9008507827a9 req-640619f6-d978-444f-8af3-5d0fbceb1289 service nova] Creating event network-vif-plugged:f3db9658-18de-42f4-8b9e-69f7017c0392 for instance 1b1fe518-288a-42d5-a385-829581568441 on hv-cinder-85600 Sep 06 04:48:42.339464 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-d1b4cb4e-71de-4b59-9c77-9008507827a9 req-640619f6-d978-444f-8af3-5d0fbceb1289 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035679 Sep 06 04:48:42.340047 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 617/1250] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:48:42.541269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-69137887-cb8e-40c1-bea1-784741b246d1 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:42.541813 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-69137887-cb8e-40c1-bea1-784741b246d1 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:42.548565 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69137887-cb8e-40c1-bea1-784741b246d1 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:42.554369 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69137887-cb8e-40c1-bea1-784741b246d1 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:42.554369 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69137887-cb8e-40c1-bea1-784741b246d1 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:42.554369 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69137887-cb8e-40c1-bea1-784741b246d1 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:42.554369 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69137887-cb8e-40c1-bea1-784741b246d1 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:42.555224 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-69137887-cb8e-40c1-bea1-784741b246d1 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:42.680710 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c3fb3235-90a6-489b-866d-5f20e546cc04 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:42.681957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c3fb3235-90a6-489b-866d-5f20e546cc04 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 17758d6d-93d6-48b1-890f-eca1a0fe0058] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:42.688032 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3fb3235-90a6-489b-866d-5f20e546cc04 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:42.688888 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3fb3235-90a6-489b-866d-5f20e546cc04 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:42.689483 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3fb3235-90a6-489b-866d-5f20e546cc04 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:42.690287 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3fb3235-90a6-489b-866d-5f20e546cc04 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:42.690809 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3fb3235-90a6-489b-866d-5f20e546cc04 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:42.691318 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3fb3235-90a6-489b-866d-5f20e546cc04 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:42.705537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-c3fb3235-90a6-489b-866d-5f20e546cc04 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] HTTP exception thrown: Instance 17758d6d-93d6-48b1-890f-eca1a0fe0058 could not be found. Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c3fb3235-90a6-489b-866d-5f20e546cc04 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Request method failure captured: Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 HTTP/1.1 Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs6XEjQEyM6nKq0ZriqSzERpRXfI9RecNHUJ07KTEpheMAPY4j1BhEyJ51sogfhmDB4NQr9DfiOQJDUhCy_PMs6jFbeLsRZSGC0Q5pjs-7hswbX4fXwXOIB6YPPmB6qqbfxN87ZX34i8V_WRilq7J0oc1TJzcbujq1FRoxGCS_iOIMk Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 375efd2890fc4b71af13439813f00ab0 Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-TestVolumeBootPattern-1515166800 Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:48:42.709153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:48:42.710943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/375efd2890fc4b71af13439813f00ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/375efd2890fc4b71af13439813f00ab0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_375efd2890fc4b71af13439813f00ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/375efd2890fc4b71af13439813f00ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:48:42.710943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-TestVolumeBootPattern-1515166800 Sep 06 04:48:42.710943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 375efd2890fc4b71af13439813f00ab0 Sep 06 04:48:42.710943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-TestVolumeBootPattern-1515166800 Sep 06 04:48:42.710943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-TestVolumeBootPattern-1515166800-project Sep 06 04:48:42.710943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:48:42.710943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:48:42.710943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 4b6c761af9c5457ea1e481ce400aded8 Sep 06 04:48:42.710943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-TestVolumeBootPattern-1515166800-project Sep 06 04:48:42.710943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:48:42.710943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 17758d6d-93d6-48b1-890f-eca1a0fe0058 could not be found. Sep 06 04:48:42.710943 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '17758d6d-93d6-48b1-890f-eca1a0fe0058'} Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17758d6d-93d6-48b1-890f-eca1a0fe0058 could not be found. Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:48:42.711957 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17758d6d-93d6-48b1-890f-eca1a0fe0058 could not be found. Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17758d6d-93d6-48b1-890f-eca1a0fe0058 could not be found. Sep 06 04:48:42.714182 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:42.716216 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c3fb3235-90a6-489b-866d-5f20e546cc04 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Returning 404 to user: Instance 17758d6d-93d6-48b1-890f-eca1a0fe0058 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:48:42.716216 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c3fb3235-90a6-489b-866d-5f20e546cc04 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058" status: 404 len: 111 microversion: 2.1 time: 0.032231 Sep 06 04:48:42.716216 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 618/1251] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:42 2022] GET /compute/v2.1/servers/17758d6d-93d6-48b1-890f-eca1a0fe0058 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:48:42.728747 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-69137887-cb8e-40c1-bea1-784741b246d1 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:42.737245 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-69137887-cb8e-40c1-bea1-784741b246d1 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1364 microversion: 2.1 time: 0.200005 Sep 06 04:48:42.738152 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 634/1252] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:42 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:43.759963 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0c6f6803-d423-45ba-965d-f8cbf6142ca7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:43.760594 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0c6f6803-d423-45ba-965d-f8cbf6142ca7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:43.767213 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c6f6803-d423-45ba-965d-f8cbf6142ca7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:43.767683 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c6f6803-d423-45ba-965d-f8cbf6142ca7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:43.768107 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c6f6803-d423-45ba-965d-f8cbf6142ca7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:43.768786 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c6f6803-d423-45ba-965d-f8cbf6142ca7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:43.769228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c6f6803-d423-45ba-965d-f8cbf6142ca7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:43.769724 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0c6f6803-d423-45ba-965d-f8cbf6142ca7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:43.902692 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0c6f6803-d423-45ba-965d-f8cbf6142ca7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:43.911533 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0c6f6803-d423-45ba-965d-f8cbf6142ca7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1364 microversion: 2.1 time: 0.155457 Sep 06 04:48:43.912093 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 619/1253] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:43 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:44.935016 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b347af28-5005-4d23-bf6e-67c192873a0b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:44.935673 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b347af28-5005-4d23-bf6e-67c192873a0b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:44.942862 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b347af28-5005-4d23-bf6e-67c192873a0b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:44.943380 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b347af28-5005-4d23-bf6e-67c192873a0b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:44.943820 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b347af28-5005-4d23-bf6e-67c192873a0b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:44.944514 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b347af28-5005-4d23-bf6e-67c192873a0b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:44.945007 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b347af28-5005-4d23-bf6e-67c192873a0b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:44.945466 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b347af28-5005-4d23-bf6e-67c192873a0b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:45.076913 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b347af28-5005-4d23-bf6e-67c192873a0b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:45.085011 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b347af28-5005-4d23-bf6e-67c192873a0b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1550 microversion: 2.1 time: 0.154084 Sep 06 04:48:45.085621 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 635/1254] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:44 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:45.107278 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b4e24f68-cab9-4b10-a386-2b826874d62c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:45.107807 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b4e24f68-cab9-4b10-a386-2b826874d62c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:45.114757 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4e24f68-cab9-4b10-a386-2b826874d62c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:45.115236 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4e24f68-cab9-4b10-a386-2b826874d62c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:45.115669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4e24f68-cab9-4b10-a386-2b826874d62c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:45.116353 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4e24f68-cab9-4b10-a386-2b826874d62c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:45.116801 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4e24f68-cab9-4b10-a386-2b826874d62c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:45.117221 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b4e24f68-cab9-4b10-a386-2b826874d62c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:45.192875 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b4e24f68-cab9-4b10-a386-2b826874d62c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089351 Sep 06 04:48:45.193566 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 620/1255] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Sep 6 04:48:45 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:48:46.239236 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-ad261bc7-5c53-4027-ab10-6396e37dbd90 req-4982ec44-0349-4fef-a4ca-f7ad82918990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b1fe518-288a-42d5-a385-829581568441", "tag": "f3db9658-18de-42f4-8b9e-69f7017c0392"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:48:46.249318 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ad261bc7-5c53-4027-ab10-6396e37dbd90 req-4982ec44-0349-4fef-a4ca-f7ad82918990 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:46.250121 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ad261bc7-5c53-4027-ab10-6396e37dbd90 req-4982ec44-0349-4fef-a4ca-f7ad82918990 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:46.250261 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-ad261bc7-5c53-4027-ab10-6396e37dbd90 req-4982ec44-0349-4fef-a4ca-f7ad82918990 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:46.262392 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-ad261bc7-5c53-4027-ab10-6396e37dbd90 req-4982ec44-0349-4fef-a4ca-f7ad82918990 service nova] Creating event network-changed:f3db9658-18de-42f4-8b9e-69f7017c0392 for instance 1b1fe518-288a-42d5-a385-829581568441 on hv-cinder-85600 Sep 06 04:48:46.267681 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-ad261bc7-5c53-4027-ab10-6396e37dbd90 req-4982ec44-0349-4fef-a4ca-f7ad82918990 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032530 Sep 06 04:48:46.268627 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 636/1256] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:48:46.402658 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-68816685-5698-4b89-976e-0cd3b552a272 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:46.403200 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-68816685-5698-4b89-976e-0cd3b552a272 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:46.405009 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-2651b9af-36ce-4be0-abe1-2d672eee2652 req-928b21ef-7651-4e91-9bbf-7f9489b69760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65eefee7-f977-45ba-92a9-d0a97facdad7", "tag": "8a88b191-41e1-4780-8ac2-cac44e992df0"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:48:46.416571 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-2651b9af-36ce-4be0-abe1-2d672eee2652 req-928b21ef-7651-4e91-9bbf-7f9489b69760 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:46.417378 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-2651b9af-36ce-4be0-abe1-2d672eee2652 req-928b21ef-7651-4e91-9bbf-7f9489b69760 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:46.417983 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-2651b9af-36ce-4be0-abe1-2d672eee2652 req-928b21ef-7651-4e91-9bbf-7f9489b69760 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:46.420750 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68816685-5698-4b89-976e-0cd3b552a272 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:46.421390 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68816685-5698-4b89-976e-0cd3b552a272 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:46.421845 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68816685-5698-4b89-976e-0cd3b552a272 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:46.423355 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68816685-5698-4b89-976e-0cd3b552a272 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:46.423821 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68816685-5698-4b89-976e-0cd3b552a272 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:46.424874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-68816685-5698-4b89-976e-0cd3b552a272 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:46.431728 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-2651b9af-36ce-4be0-abe1-2d672eee2652 req-928b21ef-7651-4e91-9bbf-7f9489b69760 service nova] Creating event network-changed:8a88b191-41e1-4780-8ac2-cac44e992df0 for instance 65eefee7-f977-45ba-92a9-d0a97facdad7 on hv-cinder-85600 Sep 06 04:48:46.436832 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-2651b9af-36ce-4be0-abe1-2d672eee2652 req-928b21ef-7651-4e91-9bbf-7f9489b69760 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035956 Sep 06 04:48:46.438212 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 637/1257] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:48:46.474680 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-68816685-5698-4b89-976e-0cd3b552a272 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:48:46.900668 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-68816685-5698-4b89-976e-0cd3b552a272 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "DELETE /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 204 len: 0 microversion: 2.1 time: 0.502321 Sep 06 04:48:46.901499 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 621/1258] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:48:46 2022] DELETE /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:48:46.912207 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fbcc4fee-5fc1-4572-be95-60773da6504d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:46.912931 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fbcc4fee-5fc1-4572-be95-60773da6504d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:46.925062 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fbcc4fee-5fc1-4572-be95-60773da6504d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:46.925589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fbcc4fee-5fc1-4572-be95-60773da6504d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:46.926037 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fbcc4fee-5fc1-4572-be95-60773da6504d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:46.928766 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fbcc4fee-5fc1-4572-be95-60773da6504d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:46.929249 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fbcc4fee-5fc1-4572-be95-60773da6504d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:46.929710 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fbcc4fee-5fc1-4572-be95-60773da6504d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:47.095228 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-fbcc4fee-5fc1-4572-be95-60773da6504d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:47.105445 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fbcc4fee-5fc1-4572-be95-60773da6504d tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1577 microversion: 2.1 time: 0.199283 Sep 06 04:48:47.106857 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 638/1259] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:46 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1577 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:48.131555 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-983ba3b1-cb50-4e64-9d6c-18fe64e3e8b3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:48.132249 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-983ba3b1-cb50-4e64-9d6c-18fe64e3e8b3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:48.138659 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-983ba3b1-cb50-4e64-9d6c-18fe64e3e8b3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:48.139135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-983ba3b1-cb50-4e64-9d6c-18fe64e3e8b3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:48.139561 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-983ba3b1-cb50-4e64-9d6c-18fe64e3e8b3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:48.140248 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-983ba3b1-cb50-4e64-9d6c-18fe64e3e8b3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:48.140693 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-983ba3b1-cb50-4e64-9d6c-18fe64e3e8b3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:48.141102 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-983ba3b1-cb50-4e64-9d6c-18fe64e3e8b3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:48.305870 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-983ba3b1-cb50-4e64-9d6c-18fe64e3e8b3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:48.314818 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-983ba3b1-cb50-4e64-9d6c-18fe64e3e8b3 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1459 microversion: 2.1 time: 0.187353 Sep 06 04:48:48.315563 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 622/1260] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:48 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1459 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:48.358474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-299d48bb-47a4-4a39-adcb-c763d315506f req-2e4fcd82-d808-49ae-bd6e-47877b5eb10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65eefee7-f977-45ba-92a9-d0a97facdad7", "name": "network-vif-deleted", "tag": "8a88b191-41e1-4780-8ac2-cac44e992df0"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:48:48.369865 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-299d48bb-47a4-4a39-adcb-c763d315506f req-2e4fcd82-d808-49ae-bd6e-47877b5eb10e service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:48.370376 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-299d48bb-47a4-4a39-adcb-c763d315506f req-2e4fcd82-d808-49ae-bd6e-47877b5eb10e service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:48.370844 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-299d48bb-47a4-4a39-adcb-c763d315506f req-2e4fcd82-d808-49ae-bd6e-47877b5eb10e service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:48.383943 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-299d48bb-47a4-4a39-adcb-c763d315506f req-2e4fcd82-d808-49ae-bd6e-47877b5eb10e service nova] Creating event network-vif-deleted:8a88b191-41e1-4780-8ac2-cac44e992df0 for instance 65eefee7-f977-45ba-92a9-d0a97facdad7 on hv-cinder-85600 Sep 06 04:48:48.388758 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-299d48bb-47a4-4a39-adcb-c763d315506f req-2e4fcd82-d808-49ae-bd6e-47877b5eb10e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035010 Sep 06 04:48:48.389414 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 639/1261] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:48:49.337935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7f1eeaea-6b66-42cd-ac7c-429471ff26a6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:49.338487 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7f1eeaea-6b66-42cd-ac7c-429471ff26a6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:49.344852 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f1eeaea-6b66-42cd-ac7c-429471ff26a6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:49.345358 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f1eeaea-6b66-42cd-ac7c-429471ff26a6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:49.345801 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f1eeaea-6b66-42cd-ac7c-429471ff26a6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:49.346488 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f1eeaea-6b66-42cd-ac7c-429471ff26a6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:49.346961 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f1eeaea-6b66-42cd-ac7c-429471ff26a6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:49.347384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f1eeaea-6b66-42cd-ac7c-429471ff26a6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:49.379119 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f1eeaea-6b66-42cd-ac7c-429471ff26a6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:49.379615 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f1eeaea-6b66-42cd-ac7c-429471ff26a6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:49.380057 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7f1eeaea-6b66-42cd-ac7c-429471ff26a6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:49.380519 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-7f1eeaea-6b66-42cd-ac7c-429471ff26a6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lazy-loading 'fault' on Instance uuid 65eefee7-f977-45ba-92a9-d0a97facdad7 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:48:49.420291 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7f1eeaea-6b66-42cd-ac7c-429471ff26a6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6c761af9c5457ea1e481ce400aded8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375efd2890fc4b71af13439813f00ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:48:49.429092 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7f1eeaea-6b66-42cd-ac7c-429471ff26a6 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 200 len: 1229 microversion: 2.1 time: 0.095076 Sep 06 04:48:49.429695 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 623/1262] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:49 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:48:50.453646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-48e5b746-5eb5-4b19-a5ae-04d6c20b1809 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:50.454343 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-48e5b746-5eb5-4b19-a5ae-04d6c20b1809 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: 65eefee7-f977-45ba-92a9-d0a97facdad7] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:50.461565 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48e5b746-5eb5-4b19-a5ae-04d6c20b1809 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:50.462050 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48e5b746-5eb5-4b19-a5ae-04d6c20b1809 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:50.462488 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48e5b746-5eb5-4b19-a5ae-04d6c20b1809 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:50.463218 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48e5b746-5eb5-4b19-a5ae-04d6c20b1809 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:50.463673 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48e5b746-5eb5-4b19-a5ae-04d6c20b1809 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:50.464095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-48e5b746-5eb5-4b19-a5ae-04d6c20b1809 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:50.477711 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-48e5b746-5eb5-4b19-a5ae-04d6c20b1809 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] HTTP exception thrown: Instance 65eefee7-f977-45ba-92a9-d0a97facdad7 could not be found. Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-48e5b746-5eb5-4b19-a5ae-04d6c20b1809 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Request method failure captured: Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 HTTP/1.1 Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs6XEjQEyM6nKq0ZriqSzERpRXfI9RecNHUJ07KTEpheMAPY4j1BhEyJ51sogfhmDB4NQr9DfiOQJDUhCy_PMs6jFbeLsRZSGC0Q5pjs-7hswbX4fXwXOIB6YPPmB6qqbfxN87ZX34i8V_WRilq7J0oc1TJzcbujq1FRoxGCS_iOIMk Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 375efd2890fc4b71af13439813f00ab0 Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-TestVolumeBootPattern-1515166800 Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:48:50.479346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:48:50.481134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/375efd2890fc4b71af13439813f00ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/375efd2890fc4b71af13439813f00ab0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_375efd2890fc4b71af13439813f00ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/375efd2890fc4b71af13439813f00ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:48:50.481134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-TestVolumeBootPattern-1515166800 Sep 06 04:48:50.481134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 375efd2890fc4b71af13439813f00ab0 Sep 06 04:48:50.481134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-TestVolumeBootPattern-1515166800 Sep 06 04:48:50.481134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-TestVolumeBootPattern-1515166800-project Sep 06 04:48:50.481134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:48:50.481134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:48:50.481134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 4b6c761af9c5457ea1e481ce400aded8 Sep 06 04:48:50.481134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-TestVolumeBootPattern-1515166800-project Sep 06 04:48:50.481134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:48:50.481134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 65eefee7-f977-45ba-92a9-d0a97facdad7 could not be found. Sep 06 04:48:50.481134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '65eefee7-f977-45ba-92a9-d0a97facdad7'} Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65eefee7-f977-45ba-92a9-d0a97facdad7 could not be found. Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:48:50.482321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65eefee7-f977-45ba-92a9-d0a97facdad7 could not be found. Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65eefee7-f977-45ba-92a9-d0a97facdad7 could not be found. Sep 06 04:48:50.484044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:50.485730 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-48e5b746-5eb5-4b19-a5ae-04d6c20b1809 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Returning 404 to user: Instance 65eefee7-f977-45ba-92a9-d0a97facdad7 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:48:50.485730 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-48e5b746-5eb5-4b19-a5ae-04d6c20b1809 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7" status: 404 len: 111 microversion: 2.1 time: 0.031841 Sep 06 04:48:50.485730 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 640/1263] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:50 2022] GET /compute/v2.1/servers/65eefee7-f977-45ba-92a9-d0a97facdad7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:48:51.004289 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a84e044c-804e-400a-8844-e47b34ffd467 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:51.004799 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a84e044c-804e-400a-8844-e47b34ffd467 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:51.011113 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a84e044c-804e-400a-8844-e47b34ffd467 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:51.011589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a84e044c-804e-400a-8844-e47b34ffd467 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:51.012020 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a84e044c-804e-400a-8844-e47b34ffd467 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:51.012697 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a84e044c-804e-400a-8844-e47b34ffd467 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:51.013142 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a84e044c-804e-400a-8844-e47b34ffd467 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:51.013588 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a84e044c-804e-400a-8844-e47b34ffd467 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:51.017620 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:48:51.026739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-a84e044c-804e-400a-8844-e47b34ffd467 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] HTTP exception thrown: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a84e044c-804e-400a-8844-e47b34ffd467 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Request method failure captured: Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 HTTP/1.1 Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFs6XEjQEyM6nKq0ZriqSzERpRXfI9RecNHUJ07KTEpheMAPY4j1BhEyJ51sogfhmDB4NQr9DfiOQJDUhCy_PMs6jFbeLsRZSGC0Q5pjs-7hswbX4fXwXOIB6YPPmB6qqbfxN87ZX34i8V_WRilq7J0oc1TJzcbujq1FRoxGCS_iOIMk Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: 375efd2890fc4b71af13439813f00ab0 Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-TestVolumeBootPattern-1515166800 Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:48:51.029589 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:48:51.031565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/375efd2890fc4b71af13439813f00ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/375efd2890fc4b71af13439813f00ab0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_375efd2890fc4b71af13439813f00ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/375efd2890fc4b71af13439813f00ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:48:51.031565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-TestVolumeBootPattern-1515166800 Sep 06 04:48:51.031565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: 375efd2890fc4b71af13439813f00ab0 Sep 06 04:48:51.031565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-TestVolumeBootPattern-1515166800 Sep 06 04:48:51.031565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-TestVolumeBootPattern-1515166800-project Sep 06 04:48:51.031565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:48:51.031565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:48:51.031565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 4b6c761af9c5457ea1e481ce400aded8 Sep 06 04:48:51.031565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-TestVolumeBootPattern-1515166800-project Sep 06 04:48:51.031565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:48:51.031565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. Sep 06 04:48:51.031565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': 'aacebb8e-d1b3-4ca8-87ac-3eb37184f747'} Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:48:51.032567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. Sep 06 04:48:51.034254 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:48:51.036618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a84e044c-804e-400a-8844-e47b34ffd467 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Returning 404 to user: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:48:51.036618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a84e044c-804e-400a-8844-e47b34ffd467 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "DELETE /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 404 len: 111 microversion: 2.1 time: 0.029217 Sep 06 04:48:51.036618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 624/1264] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:48:50 2022] DELETE /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:48:51.038953 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b0c68537-426f-41d4-876e-7446b2ca1d64 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:51.039557 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b0c68537-426f-41d4-876e-7446b2ca1d64 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] [instance: aacebb8e-d1b3-4ca8-87ac-3eb37184f747] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:48:51.045503 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0c68537-426f-41d4-876e-7446b2ca1d64 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:51.045939 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0c68537-426f-41d4-876e-7446b2ca1d64 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:51.046379 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0c68537-426f-41d4-876e-7446b2ca1d64 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:51.047053 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0c68537-426f-41d4-876e-7446b2ca1d64 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:48:51.047500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0c68537-426f-41d4-876e-7446b2ca1d64 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:48:51.047916 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b0c68537-426f-41d4-876e-7446b2ca1d64 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:48:51.061694 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-b0c68537-426f-41d4-876e-7446b2ca1d64 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] HTTP exception thrown: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b0c68537-426f-41d4-876e-7446b2ca1d64 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Request method failure captured: Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 HTTP/1.1 Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFs6XEjQEyM6nKq0ZriqSzERpRXfI9RecNHUJ07KTEpheMAPY4j1BhEyJ51sogfhmDB4NQr9DfiOQJDUhCy_PMs6jFbeLsRZSGC0Q5pjs-7hswbX4fXwXOIB6YPPmB6qqbfxN87ZX34i8V_WRilq7J0oc1TJzcbujq1FRoxGCS_iOIMk Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 375efd2890fc4b71af13439813f00ab0 Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-TestVolumeBootPattern-1515166800 Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:48:51.063182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:48:51.064868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/375efd2890fc4b71af13439813f00ab0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/375efd2890fc4b71af13439813f00ab0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_375efd2890fc4b71af13439813f00ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/375efd2890fc4b71af13439813f00ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:48:51.064868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-TestVolumeBootPattern-1515166800 Sep 06 04:48:51.064868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 375efd2890fc4b71af13439813f00ab0 Sep 06 04:48:51.064868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-TestVolumeBootPattern-1515166800 Sep 06 04:48:51.064868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-TestVolumeBootPattern-1515166800-project Sep 06 04:48:51.064868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:48:51.064868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:48:51.064868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 4b6c761af9c5457ea1e481ce400aded8 Sep 06 04:48:51.064868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-TestVolumeBootPattern-1515166800-project Sep 06 04:48:51.064868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:48:51.064868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. Sep 06 04:48:51.064868 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': 'aacebb8e-d1b3-4ca8-87ac-3eb37184f747'} Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:48:51.065871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. Sep 06 04:48:51.067479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:48:51.068940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b0c68537-426f-41d4-876e-7446b2ca1d64 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Returning 404 to user: Instance aacebb8e-d1b3-4ca8-87ac-3eb37184f747 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:48:51.068940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b0c68537-426f-41d4-876e-7446b2ca1d64 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747" status: 404 len: 111 microversion: 2.1 time: 0.029861 Sep 06 04:48:51.068940 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 641/1265] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:48:51 2022] GET /compute/v2.1/servers/aacebb8e-d1b3-4ca8-87ac-3eb37184f747 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:48:52.544897 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dec1e5a7-f30a-45dc-9e31-ed7ba34423a1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] Calling method '.version_select at 0x7f3179d835e0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:48:52.655079 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dec1e5a7-f30a-45dc-9e31-ed7ba34423a1 tempest-TestVolumeBootPattern-1515166800 tempest-TestVolumeBootPattern-1515166800-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-153806682" status: 202 len: 0 microversion: 2.1 time: 0.114660 Sep 06 04:48:52.655972 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 625/1266] 10.222.0.30 () {58 vars in 1260 bytes} [Tue Sep 6 04:48:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-153806682 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:49:51.071508 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:49:51.072249 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:49:51.076770 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-fd9f9c59-48d1-47cc-826b-3a813858807d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:49:51.077356 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-fd9f9c59-48d1-47cc-826b-3a813858807d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:49:51.083308 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd9f9c59-48d1-47cc-826b-3a813858807d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:49:51.083785 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd9f9c59-48d1-47cc-826b-3a813858807d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:49:51.084213 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd9f9c59-48d1-47cc-826b-3a813858807d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:49:51.084887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd9f9c59-48d1-47cc-826b-3a813858807d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:49:51.085362 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd9f9c59-48d1-47cc-826b-3a813858807d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:49:51.085783 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-fd9f9c59-48d1-47cc-826b-3a813858807d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:49:51.109764 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-fd9f9c59-48d1-47cc-826b-3a813858807d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/ips" status: 200 len: 146 microversion: 2.1 time: 0.040330 Sep 06 04:49:51.110318 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 642/1267] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Sep 6 04:49:51 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:49:55.456273 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:49:55.457116 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 04:49:55.457253 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Tue Sep 6 04:49:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/os-volume_attachments (ip 10.222.0.30) !!! Sep 06 04:49:55.462271 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-06e1ece9-f645-4eed-8175-bb5d2ad8a9cf tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17a0072a-a9b2-440c-852c-d81541d03f3e"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:49:55.464557 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-06e1ece9-f645-4eed-8175-bb5d2ad8a9cf tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:49:55.472839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06e1ece9-f645-4eed-8175-bb5d2ad8a9cf tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:49:55.474376 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06e1ece9-f645-4eed-8175-bb5d2ad8a9cf tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:49:55.474376 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06e1ece9-f645-4eed-8175-bb5d2ad8a9cf tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:49:55.474601 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06e1ece9-f645-4eed-8175-bb5d2ad8a9cf tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:49:55.474928 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06e1ece9-f645-4eed-8175-bb5d2ad8a9cf tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:49:55.475353 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-06e1ece9-f645-4eed-8175-bb5d2ad8a9cf tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:49:56.159855 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-06e1ece9-f645-4eed-8175-bb5d2ad8a9cf tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "POST /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.705604 Sep 06 04:49:56.160565 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 626/1268] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Sep 6 04:49:55 2022] POST /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/os-volume_attachments => generated 194 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:50:03.699029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-628cf006-a66e-4cee-bc61-752fc6684666 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:50:03.706750 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-628cf006-a66e-4cee-bc61-752fc6684666 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:03.707240 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-628cf006-a66e-4cee-bc61-752fc6684666 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:03.707676 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-628cf006-a66e-4cee-bc61-752fc6684666 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:03.768310 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-628cf006-a66e-4cee-bc61-752fc6684666 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Going to try to stop instance {{(pid=127618) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 04:50:03.967361 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-628cf006-a66e-4cee-bc61-752fc6684666 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "POST /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/action" status: 202 len: 0 microversion: 2.1 time: 0.272642 Sep 06 04:50:03.967878 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 643/1269] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Sep 6 04:50:03 2022] POST /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:50:03.977373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-65ff90ef-b635-48e0-a829-59e2d0d61519 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:50:03.978077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-65ff90ef-b635-48e0-a829-59e2d0d61519 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:50:03.985400 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-65ff90ef-b635-48e0-a829-59e2d0d61519 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:03.985882 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-65ff90ef-b635-48e0-a829-59e2d0d61519 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:03.986315 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-65ff90ef-b635-48e0-a829-59e2d0d61519 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:03.987011 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-65ff90ef-b635-48e0-a829-59e2d0d61519 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:03.987458 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-65ff90ef-b635-48e0-a829-59e2d0d61519 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:03.987880 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-65ff90ef-b635-48e0-a829-59e2d0d61519 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:04.121859 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-65ff90ef-b635-48e0-a829-59e2d0d61519 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:50:04.130056 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-65ff90ef-b635-48e0-a829-59e2d0d61519 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1725 microversion: 2.1 time: 0.156965 Sep 06 04:50:04.130613 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 627/1270] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:50:03 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:50:05.154702 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5408f076-373b-40af-824c-8ee0bd55a9a9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:50:05.155321 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5408f076-373b-40af-824c-8ee0bd55a9a9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:50:05.161724 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5408f076-373b-40af-824c-8ee0bd55a9a9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:05.162217 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5408f076-373b-40af-824c-8ee0bd55a9a9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:05.162652 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5408f076-373b-40af-824c-8ee0bd55a9a9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:05.163346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5408f076-373b-40af-824c-8ee0bd55a9a9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:05.163803 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5408f076-373b-40af-824c-8ee0bd55a9a9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:05.164230 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5408f076-373b-40af-824c-8ee0bd55a9a9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:05.292205 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5408f076-373b-40af-824c-8ee0bd55a9a9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:50:05.300474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5408f076-373b-40af-824c-8ee0bd55a9a9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1725 microversion: 2.1 time: 0.150573 Sep 06 04:50:05.301062 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 644/1271] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:50:05 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:50:06.323587 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-26030cc7-5dc9-4b18-aa78-dd514517a082 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:50:06.324167 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-26030cc7-5dc9-4b18-aa78-dd514517a082 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:50:06.331282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26030cc7-5dc9-4b18-aa78-dd514517a082 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:06.331758 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26030cc7-5dc9-4b18-aa78-dd514517a082 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:06.332187 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26030cc7-5dc9-4b18-aa78-dd514517a082 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:06.332865 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26030cc7-5dc9-4b18-aa78-dd514517a082 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:06.333328 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26030cc7-5dc9-4b18-aa78-dd514517a082 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:06.333740 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-26030cc7-5dc9-4b18-aa78-dd514517a082 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:06.460375 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-26030cc7-5dc9-4b18-aa78-dd514517a082 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:50:06.468998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-26030cc7-5dc9-4b18-aa78-dd514517a082 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1725 microversion: 2.1 time: 0.148778 Sep 06 04:50:06.469196 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 628/1272] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:50:06 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:50:07.490810 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-64a39832-b80b-479d-ac32-99692fb5c801 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:50:07.491445 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-64a39832-b80b-479d-ac32-99692fb5c801 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:50:07.497540 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64a39832-b80b-479d-ac32-99692fb5c801 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:07.498026 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64a39832-b80b-479d-ac32-99692fb5c801 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:07.498459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64a39832-b80b-479d-ac32-99692fb5c801 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:07.499142 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64a39832-b80b-479d-ac32-99692fb5c801 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:07.499724 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64a39832-b80b-479d-ac32-99692fb5c801 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:07.503763 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-64a39832-b80b-479d-ac32-99692fb5c801 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:07.634377 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-64a39832-b80b-479d-ac32-99692fb5c801 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:50:07.643074 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-64a39832-b80b-479d-ac32-99692fb5c801 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1725 microversion: 2.1 time: 0.156139 Sep 06 04:50:07.643642 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 645/1273] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:50:07 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:50:08.666087 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7234252b-7bbd-4f8c-85d2-7c9f28a1f38f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:50:08.666639 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7234252b-7bbd-4f8c-85d2-7c9f28a1f38f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:50:08.673016 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7234252b-7bbd-4f8c-85d2-7c9f28a1f38f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:08.673531 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7234252b-7bbd-4f8c-85d2-7c9f28a1f38f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:08.673962 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7234252b-7bbd-4f8c-85d2-7c9f28a1f38f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:08.674639 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7234252b-7bbd-4f8c-85d2-7c9f28a1f38f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:08.675082 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7234252b-7bbd-4f8c-85d2-7c9f28a1f38f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:08.675493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7234252b-7bbd-4f8c-85d2-7c9f28a1f38f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:08.801897 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7234252b-7bbd-4f8c-85d2-7c9f28a1f38f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:50:08.810000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7234252b-7bbd-4f8c-85d2-7c9f28a1f38f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1725 microversion: 2.1 time: 0.147794 Sep 06 04:50:08.810581 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 629/1274] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:50:08 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:50:09.833843 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8d803a2e-d768-418e-a861-6a38f1200443 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:50:09.834459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8d803a2e-d768-418e-a861-6a38f1200443 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:50:09.840916 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d803a2e-d768-418e-a861-6a38f1200443 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:09.841441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d803a2e-d768-418e-a861-6a38f1200443 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:09.841883 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d803a2e-d768-418e-a861-6a38f1200443 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:09.842575 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d803a2e-d768-418e-a861-6a38f1200443 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:09.843032 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d803a2e-d768-418e-a861-6a38f1200443 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:09.844005 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8d803a2e-d768-418e-a861-6a38f1200443 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:09.975450 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-8d803a2e-d768-418e-a861-6a38f1200443 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:50:09.983613 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8d803a2e-d768-418e-a861-6a38f1200443 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1725 microversion: 2.1 time: 0.153741 Sep 06 04:50:09.984792 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 646/1275] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:50:09 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:50:11.007364 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4bad1968-2b78-4153-a660-67fc6033574a tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:50:11.007966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4bad1968-2b78-4153-a660-67fc6033574a tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:50:11.015006 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4bad1968-2b78-4153-a660-67fc6033574a tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:11.016291 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4bad1968-2b78-4153-a660-67fc6033574a tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:11.016993 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4bad1968-2b78-4153-a660-67fc6033574a tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:11.017903 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4bad1968-2b78-4153-a660-67fc6033574a tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:11.018683 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4bad1968-2b78-4153-a660-67fc6033574a tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:11.019288 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4bad1968-2b78-4153-a660-67fc6033574a tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:11.170677 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4bad1968-2b78-4153-a660-67fc6033574a tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:50:11.179712 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4bad1968-2b78-4153-a660-67fc6033574a tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1725 microversion: 2.1 time: 0.176120 Sep 06 04:50:11.180292 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 630/1276] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:50:11 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:50:12.204243 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3b9968d6-6a91-46d1-aaad-a600c40d5db3 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:50:12.204898 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3b9968d6-6a91-46d1-aaad-a600c40d5db3 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:50:12.211244 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b9968d6-6a91-46d1-aaad-a600c40d5db3 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:12.211726 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b9968d6-6a91-46d1-aaad-a600c40d5db3 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:12.212475 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b9968d6-6a91-46d1-aaad-a600c40d5db3 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:12.212835 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b9968d6-6a91-46d1-aaad-a600c40d5db3 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:12.213288 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b9968d6-6a91-46d1-aaad-a600c40d5db3 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:12.213752 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3b9968d6-6a91-46d1-aaad-a600c40d5db3 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:12.340989 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3b9968d6-6a91-46d1-aaad-a600c40d5db3 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:50:12.349752 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3b9968d6-6a91-46d1-aaad-a600c40d5db3 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1725 microversion: 2.1 time: 0.150476 Sep 06 04:50:12.350314 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 647/1277] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:50:12 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:50:13.373497 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f27140d5-6532-43ae-8397-630227681290 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:50:13.374109 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f27140d5-6532-43ae-8397-630227681290 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:50:13.380516 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f27140d5-6532-43ae-8397-630227681290 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:13.380996 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f27140d5-6532-43ae-8397-630227681290 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:13.381462 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f27140d5-6532-43ae-8397-630227681290 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:13.382160 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f27140d5-6532-43ae-8397-630227681290 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:13.382614 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f27140d5-6532-43ae-8397-630227681290 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:13.383048 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f27140d5-6532-43ae-8397-630227681290 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:13.508585 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f27140d5-6532-43ae-8397-630227681290 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:50:13.517387 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f27140d5-6532-43ae-8397-630227681290 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1725 microversion: 2.1 time: 0.147745 Sep 06 04:50:13.517953 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 631/1278] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:50:13 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:50:14.541022 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-90eadde2-4b6d-49c0-a3d8-46accf75c270 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:50:14.541672 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-90eadde2-4b6d-49c0-a3d8-46accf75c270 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:50:14.548121 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90eadde2-4b6d-49c0-a3d8-46accf75c270 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:14.553408 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90eadde2-4b6d-49c0-a3d8-46accf75c270 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:14.553408 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90eadde2-4b6d-49c0-a3d8-46accf75c270 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:14.553408 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90eadde2-4b6d-49c0-a3d8-46accf75c270 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:14.553408 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90eadde2-4b6d-49c0-a3d8-46accf75c270 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:14.554057 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-90eadde2-4b6d-49c0-a3d8-46accf75c270 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:14.682050 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-90eadde2-4b6d-49c0-a3d8-46accf75c270 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:50:14.691278 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-90eadde2-4b6d-49c0-a3d8-46accf75c270 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1725 microversion: 2.1 time: 0.154051 Sep 06 04:50:14.691845 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 648/1279] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:50:14 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:50:15.714469 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c088288c-3127-4285-9d66-6ff491520852 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:50:15.715009 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c088288c-3127-4285-9d66-6ff491520852 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:50:15.722253 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c088288c-3127-4285-9d66-6ff491520852 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:15.722729 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c088288c-3127-4285-9d66-6ff491520852 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:15.723163 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c088288c-3127-4285-9d66-6ff491520852 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:15.723846 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c088288c-3127-4285-9d66-6ff491520852 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:15.724290 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c088288c-3127-4285-9d66-6ff491520852 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:15.724708 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c088288c-3127-4285-9d66-6ff491520852 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:15.854101 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c088288c-3127-4285-9d66-6ff491520852 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:50:15.862927 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c088288c-3127-4285-9d66-6ff491520852 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1702 microversion: 2.1 time: 0.152356 Sep 06 04:50:15.863501 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 632/1280] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:50:15 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1702 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:50:15.885545 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1e7e2843-ac83-4fbc-8a8a-8f94d6c9246f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:50:15.892481 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e7e2843-ac83-4fbc-8a8a-8f94d6c9246f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:15.892959 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e7e2843-ac83-4fbc-8a8a-8f94d6c9246f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:15.893419 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1e7e2843-ac83-4fbc-8a8a-8f94d6c9246f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:15.917791 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1e7e2843-ac83-4fbc-8a8a-8f94d6c9246f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Going to try to start instance {{(pid=127618) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 04:50:16.079394 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1e7e2843-ac83-4fbc-8a8a-8f94d6c9246f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "POST /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/action" status: 202 len: 0 microversion: 2.1 time: 0.197575 Sep 06 04:50:16.079999 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 649/1281] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Sep 6 04:50:15 2022] POST /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:50:16.088424 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dc0e9034-c002-4a24-b3fe-85aafaf505fc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:50:16.089049 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dc0e9034-c002-4a24-b3fe-85aafaf505fc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:50:16.095191 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc0e9034-c002-4a24-b3fe-85aafaf505fc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:16.095662 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc0e9034-c002-4a24-b3fe-85aafaf505fc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:16.096124 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc0e9034-c002-4a24-b3fe-85aafaf505fc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:16.096803 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc0e9034-c002-4a24-b3fe-85aafaf505fc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:16.097244 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc0e9034-c002-4a24-b3fe-85aafaf505fc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:16.097686 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc0e9034-c002-4a24-b3fe-85aafaf505fc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:16.227097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dc0e9034-c002-4a24-b3fe-85aafaf505fc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:50:16.241393 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dc0e9034-c002-4a24-b3fe-85aafaf505fc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1711 microversion: 2.1 time: 0.156798 Sep 06 04:50:16.243596 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 633/1282] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:50:16 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1711 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:50:17.264449 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ab03f272-a25a-49f6-a026-39bac717aa47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:50:17.266098 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ab03f272-a25a-49f6-a026-39bac717aa47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:50:17.272607 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab03f272-a25a-49f6-a026-39bac717aa47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:17.273134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab03f272-a25a-49f6-a026-39bac717aa47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:17.273589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab03f272-a25a-49f6-a026-39bac717aa47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:17.277106 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab03f272-a25a-49f6-a026-39bac717aa47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:17.277106 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab03f272-a25a-49f6-a026-39bac717aa47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:17.277106 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ab03f272-a25a-49f6-a026-39bac717aa47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:17.407489 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ab03f272-a25a-49f6-a026-39bac717aa47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:50:17.415907 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ab03f272-a25a-49f6-a026-39bac717aa47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1711 microversion: 2.1 time: 0.155723 Sep 06 04:50:17.420417 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 650/1283] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:50:17 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1711 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:50:18.438955 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c3dc001d-7d01-461f-9f88-dd92aa1b72eb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:50:18.439549 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c3dc001d-7d01-461f-9f88-dd92aa1b72eb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:50:18.446088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3dc001d-7d01-461f-9f88-dd92aa1b72eb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:18.446560 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3dc001d-7d01-461f-9f88-dd92aa1b72eb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:18.446989 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3dc001d-7d01-461f-9f88-dd92aa1b72eb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:18.447666 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3dc001d-7d01-461f-9f88-dd92aa1b72eb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:50:18.448109 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3dc001d-7d01-461f-9f88-dd92aa1b72eb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:50:18.448521 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c3dc001d-7d01-461f-9f88-dd92aa1b72eb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:50:18.578982 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c3dc001d-7d01-461f-9f88-dd92aa1b72eb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:50:18.587179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c3dc001d-7d01-461f-9f88-dd92aa1b72eb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1715 microversion: 2.1 time: 0.152056 Sep 06 04:50:18.587741 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 634/1284] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:50:18 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:51:21.726033 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=18 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:51:21.726705 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:51:21.730685 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-13fba5cf-ee2c-400c-8c8f-89374e7ea0c7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:51:21.731173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-13fba5cf-ee2c-400c-8c8f-89374e7ea0c7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:51:21.736969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13fba5cf-ee2c-400c-8c8f-89374e7ea0c7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:21.739821 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13fba5cf-ee2c-400c-8c8f-89374e7ea0c7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:21.739821 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13fba5cf-ee2c-400c-8c8f-89374e7ea0c7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:21.739821 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13fba5cf-ee2c-400c-8c8f-89374e7ea0c7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:21.739821 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13fba5cf-ee2c-400c-8c8f-89374e7ea0c7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:21.740236 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-13fba5cf-ee2c-400c-8c8f-89374e7ea0c7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:21.977211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-13fba5cf-ee2c-400c-8c8f-89374e7ea0c7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lazy-loading 'services' on Instance uuid 1b1fe518-288a-42d5-a385-829581568441 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:51:22.185014 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-13fba5cf-ee2c-400c-8c8f-89374e7ea0c7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/os-volume_attachments/17a0072a-a9b2-440c-852c-d81541d03f3e" status: 202 len: 0 microversion: 2.1 time: 0.460689 Sep 06 04:51:22.185659 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 651/1285] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Sep 6 04:51:21 2022] DELETE /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/os-volume_attachments/17a0072a-a9b2-440c-852c-d81541d03f3e => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:51:24.365109 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=18 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:51:24.365951 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:51:24.369877 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1f778629-8fa5-4400-9e7c-d096a9f84e47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:51:24.375637 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f778629-8fa5-4400-9e7c-d096a9f84e47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:24.382139 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f778629-8fa5-4400-9e7c-d096a9f84e47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:24.382139 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f778629-8fa5-4400-9e7c-d096a9f84e47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:24.440526 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1f778629-8fa5-4400-9e7c-d096a9f84e47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Going to try to stop instance {{(pid=127617) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 06 04:51:24.622901 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1f778629-8fa5-4400-9e7c-d096a9f84e47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "POST /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/action" status: 202 len: 0 microversion: 2.1 time: 0.259370 Sep 06 04:51:24.623467 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 635/1286] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Sep 6 04:51:24 2022] POST /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:51:24.633238 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-be172d46-7a07-4b80-8bd8-e2ad422599aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:51:24.633977 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-be172d46-7a07-4b80-8bd8-e2ad422599aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:51:24.640238 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be172d46-7a07-4b80-8bd8-e2ad422599aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:24.640724 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be172d46-7a07-4b80-8bd8-e2ad422599aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:24.641161 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be172d46-7a07-4b80-8bd8-e2ad422599aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:24.641889 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be172d46-7a07-4b80-8bd8-e2ad422599aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:24.642346 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be172d46-7a07-4b80-8bd8-e2ad422599aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:24.642795 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-be172d46-7a07-4b80-8bd8-e2ad422599aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:24.775813 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-be172d46-7a07-4b80-8bd8-e2ad422599aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:51:24.784393 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-be172d46-7a07-4b80-8bd8-e2ad422599aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1679 microversion: 2.1 time: 0.155911 Sep 06 04:51:24.784947 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 652/1287] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:51:24 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:51:25.808825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a733e9f6-0ae3-46e8-9698-fee958d59cb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:51:25.809376 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a733e9f6-0ae3-46e8-9698-fee958d59cb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:51:25.816183 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a733e9f6-0ae3-46e8-9698-fee958d59cb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:25.816658 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a733e9f6-0ae3-46e8-9698-fee958d59cb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:25.817086 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a733e9f6-0ae3-46e8-9698-fee958d59cb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:25.817796 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a733e9f6-0ae3-46e8-9698-fee958d59cb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:25.818240 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a733e9f6-0ae3-46e8-9698-fee958d59cb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:25.818653 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-a733e9f6-0ae3-46e8-9698-fee958d59cb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:26.040359 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a733e9f6-0ae3-46e8-9698-fee958d59cb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:51:26.048935 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a733e9f6-0ae3-46e8-9698-fee958d59cb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1679 microversion: 2.1 time: 0.244194 Sep 06 04:51:26.049553 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 636/1288] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:51:25 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1679 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:51:27.072091 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d381c458-3309-4274-8071-5f5a49130001 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:51:27.072672 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d381c458-3309-4274-8071-5f5a49130001 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:51:27.079698 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d381c458-3309-4274-8071-5f5a49130001 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:27.080211 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d381c458-3309-4274-8071-5f5a49130001 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:27.080642 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d381c458-3309-4274-8071-5f5a49130001 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:27.081335 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d381c458-3309-4274-8071-5f5a49130001 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:27.082051 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d381c458-3309-4274-8071-5f5a49130001 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:27.082587 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d381c458-3309-4274-8071-5f5a49130001 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:27.209918 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d381c458-3309-4274-8071-5f5a49130001 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:51:27.217833 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d381c458-3309-4274-8071-5f5a49130001 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1679 microversion: 2.1 time: 0.149581 Sep 06 04:51:27.218404 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 653/1289] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:51:27 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:51:28.241162 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b9b6aade-c6fd-4556-8b8f-c8862cb30ef9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:51:28.241757 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-b9b6aade-c6fd-4556-8b8f-c8862cb30ef9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:51:28.248190 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b9b6aade-c6fd-4556-8b8f-c8862cb30ef9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:28.248661 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b9b6aade-c6fd-4556-8b8f-c8862cb30ef9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:28.249105 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b9b6aade-c6fd-4556-8b8f-c8862cb30ef9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:28.249793 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b9b6aade-c6fd-4556-8b8f-c8862cb30ef9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:28.250240 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b9b6aade-c6fd-4556-8b8f-c8862cb30ef9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:28.250649 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-b9b6aade-c6fd-4556-8b8f-c8862cb30ef9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:28.637356 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-b9b6aade-c6fd-4556-8b8f-c8862cb30ef9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:51:28.645725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b9b6aade-c6fd-4556-8b8f-c8862cb30ef9 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1679 microversion: 2.1 time: 0.408485 Sep 06 04:51:28.646286 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 637/1290] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:51:28 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1679 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:51:29.667906 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-105590b5-f9af-4bc4-a056-bf95babb0075 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:51:29.668454 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-105590b5-f9af-4bc4-a056-bf95babb0075 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:51:29.675090 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-105590b5-f9af-4bc4-a056-bf95babb0075 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:29.675566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-105590b5-f9af-4bc4-a056-bf95babb0075 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:29.675998 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-105590b5-f9af-4bc4-a056-bf95babb0075 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:29.676675 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-105590b5-f9af-4bc4-a056-bf95babb0075 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:29.677122 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-105590b5-f9af-4bc4-a056-bf95babb0075 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:29.677574 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-105590b5-f9af-4bc4-a056-bf95babb0075 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:29.803445 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-105590b5-f9af-4bc4-a056-bf95babb0075 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:51:29.811104 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-105590b5-f9af-4bc4-a056-bf95babb0075 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1679 microversion: 2.1 time: 0.147079 Sep 06 04:51:29.811665 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 654/1291] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:51:29 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:51:30.835189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6df1c17b-15b1-477d-be37-da47f32fa784 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:51:30.835792 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6df1c17b-15b1-477d-be37-da47f32fa784 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:51:30.842408 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df1c17b-15b1-477d-be37-da47f32fa784 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:30.842889 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df1c17b-15b1-477d-be37-da47f32fa784 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:30.843348 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df1c17b-15b1-477d-be37-da47f32fa784 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:30.844031 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df1c17b-15b1-477d-be37-da47f32fa784 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:30.844475 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df1c17b-15b1-477d-be37-da47f32fa784 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:30.844889 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6df1c17b-15b1-477d-be37-da47f32fa784 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:30.977151 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-6df1c17b-15b1-477d-be37-da47f32fa784 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:51:30.984746 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6df1c17b-15b1-477d-be37-da47f32fa784 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1679 microversion: 2.1 time: 0.153401 Sep 06 04:51:30.985329 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 638/1292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:51:30 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:51:32.007623 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c1c3b53f-f0d5-42b4-b6d3-40dd17d2eaf0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:51:32.008224 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c1c3b53f-f0d5-42b4-b6d3-40dd17d2eaf0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:51:32.010698 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 04:51:32.010847 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Tue Sep 6 04:51:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 (ip 10.222.0.30) !!! Sep 06 04:51:32.012006 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 04:51:32.012137 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Tue Sep 6 04:51:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 (ip 10.222.0.30) !!! Sep 06 04:51:32.020465 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1c3b53f-f0d5-42b4-b6d3-40dd17d2eaf0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:32.020951 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1c3b53f-f0d5-42b4-b6d3-40dd17d2eaf0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:32.021411 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1c3b53f-f0d5-42b4-b6d3-40dd17d2eaf0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:32.022096 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1c3b53f-f0d5-42b4-b6d3-40dd17d2eaf0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:32.022547 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1c3b53f-f0d5-42b4-b6d3-40dd17d2eaf0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:32.022965 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1c3b53f-f0d5-42b4-b6d3-40dd17d2eaf0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:32.155769 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c1c3b53f-f0d5-42b4-b6d3-40dd17d2eaf0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:51:32.164349 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c1c3b53f-f0d5-42b4-b6d3-40dd17d2eaf0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1679 microversion: 2.1 time: 0.160544 Sep 06 04:51:32.164937 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 655/1293] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:51:32 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:51:33.188467 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-42fed34a-6218-49d8-ba49-89077531ab3f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:51:33.189441 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-42fed34a-6218-49d8-ba49-89077531ab3f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:51:33.197751 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42fed34a-6218-49d8-ba49-89077531ab3f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:33.198227 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42fed34a-6218-49d8-ba49-89077531ab3f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:33.198657 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42fed34a-6218-49d8-ba49-89077531ab3f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:33.199338 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42fed34a-6218-49d8-ba49-89077531ab3f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:33.199784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42fed34a-6218-49d8-ba49-89077531ab3f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:33.200199 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-42fed34a-6218-49d8-ba49-89077531ab3f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:33.330077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-42fed34a-6218-49d8-ba49-89077531ab3f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:51:33.337599 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-42fed34a-6218-49d8-ba49-89077531ab3f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1679 microversion: 2.1 time: 0.154153 Sep 06 04:51:33.338161 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 639/1294] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:51:33 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:51:34.361477 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-55962195-21ea-4d53-afe5-ca8d868cb099 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:51:34.365605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-55962195-21ea-4d53-afe5-ca8d868cb099 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:51:34.368752 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55962195-21ea-4d53-afe5-ca8d868cb099 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:34.369364 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55962195-21ea-4d53-afe5-ca8d868cb099 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:34.369804 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55962195-21ea-4d53-afe5-ca8d868cb099 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:34.370495 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55962195-21ea-4d53-afe5-ca8d868cb099 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:34.370942 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55962195-21ea-4d53-afe5-ca8d868cb099 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:34.371362 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-55962195-21ea-4d53-afe5-ca8d868cb099 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:34.499320 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-55962195-21ea-4d53-afe5-ca8d868cb099 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:51:34.507203 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-55962195-21ea-4d53-afe5-ca8d868cb099 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1679 microversion: 2.1 time: 0.150143 Sep 06 04:51:34.507778 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 656/1295] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:51:34 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:51:35.530654 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4d896d4e-8479-4a87-a376-acee93c30839 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:51:35.531262 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4d896d4e-8479-4a87-a376-acee93c30839 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:51:35.534737 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 04:51:35.534884 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Tue Sep 6 04:51:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 (ip 10.222.0.30) !!! Sep 06 04:51:35.541525 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d896d4e-8479-4a87-a376-acee93c30839 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:35.541995 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d896d4e-8479-4a87-a376-acee93c30839 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:35.542432 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d896d4e-8479-4a87-a376-acee93c30839 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:35.543113 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d896d4e-8479-4a87-a376-acee93c30839 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:35.543561 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d896d4e-8479-4a87-a376-acee93c30839 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:35.543976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4d896d4e-8479-4a87-a376-acee93c30839 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:35.675174 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4d896d4e-8479-4a87-a376-acee93c30839 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:51:35.682740 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4d896d4e-8479-4a87-a376-acee93c30839 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1656 microversion: 2.1 time: 0.155943 Sep 06 04:51:35.683303 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 640/1296] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:51:35 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:51:35.705729 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-50bb33f1-5363-4252-91cf-04786f950733 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:51:35.712165 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50bb33f1-5363-4252-91cf-04786f950733 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:35.712651 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50bb33f1-5363-4252-91cf-04786f950733 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:35.713089 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50bb33f1-5363-4252-91cf-04786f950733 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:35.735158 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-50bb33f1-5363-4252-91cf-04786f950733 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Going to try to start instance {{(pid=127618) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 06 04:51:35.901913 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-50bb33f1-5363-4252-91cf-04786f950733 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "POST /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/action" status: 202 len: 0 microversion: 2.1 time: 0.199775 Sep 06 04:51:35.902517 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 657/1297] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Sep 6 04:51:35 2022] POST /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:51:35.911724 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f837f210-4373-4d99-8ce7-ce118ded9565 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:51:35.912328 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-f837f210-4373-4d99-8ce7-ce118ded9565 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:51:35.918189 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f837f210-4373-4d99-8ce7-ce118ded9565 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:35.921204 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f837f210-4373-4d99-8ce7-ce118ded9565 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:35.921204 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f837f210-4373-4d99-8ce7-ce118ded9565 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:35.921204 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f837f210-4373-4d99-8ce7-ce118ded9565 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:35.921204 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f837f210-4373-4d99-8ce7-ce118ded9565 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:35.921725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-f837f210-4373-4d99-8ce7-ce118ded9565 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:36.054114 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-f837f210-4373-4d99-8ce7-ce118ded9565 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:51:36.061777 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f837f210-4373-4d99-8ce7-ce118ded9565 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1665 microversion: 2.1 time: 0.154648 Sep 06 04:51:36.062347 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 641/1298] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:51:35 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:51:37.087752 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-decff1e8-7bb6-4ee3-b5d5-5eb0098865b2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:51:37.088457 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-decff1e8-7bb6-4ee3-b5d5-5eb0098865b2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:51:37.094586 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-decff1e8-7bb6-4ee3-b5d5-5eb0098865b2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:37.095744 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-decff1e8-7bb6-4ee3-b5d5-5eb0098865b2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:37.096382 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-decff1e8-7bb6-4ee3-b5d5-5eb0098865b2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:37.097107 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-decff1e8-7bb6-4ee3-b5d5-5eb0098865b2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:37.097607 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-decff1e8-7bb6-4ee3-b5d5-5eb0098865b2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:37.098042 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-decff1e8-7bb6-4ee3-b5d5-5eb0098865b2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:37.227270 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-decff1e8-7bb6-4ee3-b5d5-5eb0098865b2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:51:37.234809 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-decff1e8-7bb6-4ee3-b5d5-5eb0098865b2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1665 microversion: 2.1 time: 0.151776 Sep 06 04:51:37.235372 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 658/1299] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:51:37 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:51:38.257247 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dbe574dd-b3df-4db9-86ab-791e08b1c18f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:51:38.257845 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dbe574dd-b3df-4db9-86ab-791e08b1c18f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:51:38.264141 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbe574dd-b3df-4db9-86ab-791e08b1c18f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:38.264614 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbe574dd-b3df-4db9-86ab-791e08b1c18f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:38.265042 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbe574dd-b3df-4db9-86ab-791e08b1c18f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:38.265755 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbe574dd-b3df-4db9-86ab-791e08b1c18f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:51:38.266223 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbe574dd-b3df-4db9-86ab-791e08b1c18f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:51:38.266704 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dbe574dd-b3df-4db9-86ab-791e08b1c18f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:51:38.394484 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-dbe574dd-b3df-4db9-86ab-791e08b1c18f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:51:38.402214 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dbe574dd-b3df-4db9-86ab-791e08b1c18f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1669 microversion: 2.1 time: 0.148954 Sep 06 04:51:38.402780 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 642/1300] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:51:38 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:52:41.620821 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=16 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:52:41.621605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:52:41.625521 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9c684911-cc93-4ad4-a5d7-d9bb40f985ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:41.627797 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9c684911-cc93-4ad4-a5d7-d9bb40f985ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:41.634349 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c684911-cc93-4ad4-a5d7-d9bb40f985ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:41.634881 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c684911-cc93-4ad4-a5d7-d9bb40f985ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:41.635269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c684911-cc93-4ad4-a5d7-d9bb40f985ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:41.635979 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c684911-cc93-4ad4-a5d7-d9bb40f985ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:41.636450 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c684911-cc93-4ad4-a5d7-d9bb40f985ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:41.636853 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9c684911-cc93-4ad4-a5d7-d9bb40f985ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:41.665333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9c684911-cc93-4ad4-a5d7-d9bb40f985ce tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046268 Sep 06 04:52:41.665871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 659/1301] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:52:41 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 04:52:41.725904 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=16 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:52:41.726659 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:52:41.730480 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1fd98242-bd7d-4f4d-8c75-34dded2c321f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:41.730977 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1fd98242-bd7d-4f4d-8c75-34dded2c321f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:41.736680 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fd98242-bd7d-4f4d-8c75-34dded2c321f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:41.737145 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fd98242-bd7d-4f4d-8c75-34dded2c321f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:41.738135 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fd98242-bd7d-4f4d-8c75-34dded2c321f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:41.738820 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fd98242-bd7d-4f4d-8c75-34dded2c321f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:41.739269 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fd98242-bd7d-4f4d-8c75-34dded2c321f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:41.739694 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1fd98242-bd7d-4f4d-8c75-34dded2c321f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:41.764692 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1fd98242-bd7d-4f4d-8c75-34dded2c321f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:52:42.028966 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1fd98242-bd7d-4f4d-8c75-34dded2c321f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 204 len: 0 microversion: 2.1 time: 0.304417 Sep 06 04:52:42.029501 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 643/1302] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:52:41 2022] DELETE /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:52:42.038671 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-b2abe9c7-ac32-4ddc-b9c4-1f4761e48119 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:42.041029 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-b2abe9c7-ac32-4ddc-b9c4-1f4761e48119 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:42.045690 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b2abe9c7-ac32-4ddc-b9c4-1f4761e48119 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:42.046170 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b2abe9c7-ac32-4ddc-b9c4-1f4761e48119 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:42.046629 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b2abe9c7-ac32-4ddc-b9c4-1f4761e48119 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:42.047308 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b2abe9c7-ac32-4ddc-b9c4-1f4761e48119 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:42.047757 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b2abe9c7-ac32-4ddc-b9c4-1f4761e48119 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:42.048184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-b2abe9c7-ac32-4ddc-b9c4-1f4761e48119 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:42.189731 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-b2abe9c7-ac32-4ddc-b9c4-1f4761e48119 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:52:42.197674 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-b2abe9c7-ac32-4ddc-b9c4-1f4761e48119 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1675 microversion: 2.1 time: 0.163602 Sep 06 04:52:42.198263 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 660/1303] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:52:42 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:52:43.221165 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-8a64cb55-b1bd-4e1c-a9ee-e5bac2f9bc20 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:43.221882 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-8a64cb55-b1bd-4e1c-a9ee-e5bac2f9bc20 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:43.228335 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8a64cb55-b1bd-4e1c-a9ee-e5bac2f9bc20 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:43.228814 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8a64cb55-b1bd-4e1c-a9ee-e5bac2f9bc20 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:43.229245 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8a64cb55-b1bd-4e1c-a9ee-e5bac2f9bc20 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:43.229951 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8a64cb55-b1bd-4e1c-a9ee-e5bac2f9bc20 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:43.230404 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8a64cb55-b1bd-4e1c-a9ee-e5bac2f9bc20 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:43.230823 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-8a64cb55-b1bd-4e1c-a9ee-e5bac2f9bc20 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:43.357443 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-8a64cb55-b1bd-4e1c-a9ee-e5bac2f9bc20 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:52:43.365282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-8a64cb55-b1bd-4e1c-a9ee-e5bac2f9bc20 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1675 microversion: 2.1 time: 0.148288 Sep 06 04:52:43.365886 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 644/1304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:52:43 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:52:44.388120 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6997c17b-feb4-435a-a1be-c4ffec388d6c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:44.388727 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6997c17b-feb4-435a-a1be-c4ffec388d6c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:44.395287 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6997c17b-feb4-435a-a1be-c4ffec388d6c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:44.400173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6997c17b-feb4-435a-a1be-c4ffec388d6c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:44.400173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6997c17b-feb4-435a-a1be-c4ffec388d6c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:44.400173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6997c17b-feb4-435a-a1be-c4ffec388d6c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:44.400173 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6997c17b-feb4-435a-a1be-c4ffec388d6c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:44.400728 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6997c17b-feb4-435a-a1be-c4ffec388d6c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:44.546156 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6997c17b-feb4-435a-a1be-c4ffec388d6c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:52:44.554088 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6997c17b-feb4-435a-a1be-c4ffec388d6c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1675 microversion: 2.1 time: 0.169852 Sep 06 04:52:44.554660 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 661/1305] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:52:44 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:52:45.171425 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-0080b8be-e63f-452e-af5a-45ad29d9f49d req-c37421f2-5159-47b4-b07b-6f0ce6802fa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b1fe518-288a-42d5-a385-829581568441", "name": "network-vif-deleted", "tag": "f3db9658-18de-42f4-8b9e-69f7017c0392"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:52:45.182171 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0080b8be-e63f-452e-af5a-45ad29d9f49d req-c37421f2-5159-47b4-b07b-6f0ce6802fa7 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:45.182889 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0080b8be-e63f-452e-af5a-45ad29d9f49d req-c37421f2-5159-47b4-b07b-6f0ce6802fa7 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:45.183503 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-0080b8be-e63f-452e-af5a-45ad29d9f49d req-c37421f2-5159-47b4-b07b-6f0ce6802fa7 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:45.195803 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-0080b8be-e63f-452e-af5a-45ad29d9f49d req-c37421f2-5159-47b4-b07b-6f0ce6802fa7 service nova] Creating event network-vif-deleted:f3db9658-18de-42f4-8b9e-69f7017c0392 for instance 1b1fe518-288a-42d5-a385-829581568441 on hv-cinder-85600 Sep 06 04:52:45.201040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-0080b8be-e63f-452e-af5a-45ad29d9f49d req-c37421f2-5159-47b4-b07b-6f0ce6802fa7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092798 Sep 06 04:52:45.202170 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 645/1306] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:52:45.577731 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-681f0cda-2ef8-4594-b6b6-b90b6071232d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:45.578423 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-681f0cda-2ef8-4594-b6b6-b90b6071232d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:45.585472 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-681f0cda-2ef8-4594-b6b6-b90b6071232d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:45.585964 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-681f0cda-2ef8-4594-b6b6-b90b6071232d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:45.586403 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-681f0cda-2ef8-4594-b6b6-b90b6071232d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:45.587105 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-681f0cda-2ef8-4594-b6b6-b90b6071232d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:45.587618 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-681f0cda-2ef8-4594-b6b6-b90b6071232d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:45.588051 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-681f0cda-2ef8-4594-b6b6-b90b6071232d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:45.619796 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-681f0cda-2ef8-4594-b6b6-b90b6071232d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:45.620283 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-681f0cda-2ef8-4594-b6b6-b90b6071232d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:45.620725 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-681f0cda-2ef8-4594-b6b6-b90b6071232d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:45.621195 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.objects.instance [None req-681f0cda-2ef8-4594-b6b6-b90b6071232d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lazy-loading 'fault' on Instance uuid 1b1fe518-288a-42d5-a385-829581568441 {{(pid=127618) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:52:45.664039 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-681f0cda-2ef8-4594-b6b6-b90b6071232d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:52:45.672208 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-681f0cda-2ef8-4594-b6b6-b90b6071232d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 200 len: 1328 microversion: 2.1 time: 0.098493 Sep 06 04:52:45.672792 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 662/1307] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:52:45 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:52:46.695483 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2e16aaed-809e-497d-b784-5b96f430e689 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:46.696087 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2e16aaed-809e-497d-b784-5b96f430e689 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:46.702604 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e16aaed-809e-497d-b784-5b96f430e689 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:46.703079 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e16aaed-809e-497d-b784-5b96f430e689 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:46.703516 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e16aaed-809e-497d-b784-5b96f430e689 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:46.704188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e16aaed-809e-497d-b784-5b96f430e689 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:46.704633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e16aaed-809e-497d-b784-5b96f430e689 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:46.705051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2e16aaed-809e-497d-b784-5b96f430e689 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:46.718574 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-2e16aaed-809e-497d-b784-5b96f430e689 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] HTTP exception thrown: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2e16aaed-809e-497d-b784-5b96f430e689 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Request method failure captured: Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 HTTP/1.1 Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFtEa2RBYoPpw4bA3Ri0CxPZTQv5LG8ZoPb13IV3KJ6KLHQQpUoBvxRTZJCZThdHULwdjirVwlyQa7QQhPioROjFHkWCl1HaAiVxA9HU-pT7jwUisehEZgoSuodsCYUx-a1gWdAU1qpflC9UemjYRl6MpmpXUUTGxEvV4jidAOjbUORU Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: f91efa94deff4ceb80b0a1aa88087421 Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:52:46.720146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:52:46.722103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:52:46.722103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:52:46.722103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: f91efa94deff4ceb80b0a1aa88087421 Sep 06 04:52:46.722103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:52:46.722103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeTestJSON-1376563755-project Sep 06 04:52:46.722103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:52:46.722103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:52:46.722103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 31b919a031504f2bace596da457b91cf Sep 06 04:52:46.722103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeTestJSON-1376563755-project Sep 06 04:52:46.722103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:52:46.722103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. Sep 06 04:52:46.722103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '1b1fe518-288a-42d5-a385-829581568441'} Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:52:46.723911 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. Sep 06 04:52:46.725725 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:52:46.727261 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2e16aaed-809e-497d-b784-5b96f430e689 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Returning 404 to user: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:52:46.727261 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2e16aaed-809e-497d-b784-5b96f430e689 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 404 len: 111 microversion: 2.1 time: 0.030311 Sep 06 04:52:46.727261 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 646/1308] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:52:46 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:52:46.730984 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c93658b8-5a87-4df2-81a0-d847382bc339 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '.version_select at 0x7f3176631940>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:46.800733 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c93658b8-5a87-4df2-81a0-d847382bc339 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1495182289" status: 202 len: 0 microversion: 2.1 time: 0.073496 Sep 06 04:52:46.801363 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 663/1309] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Sep 6 04:52:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1495182289 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:52:47.524904 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-b0c8d966-2b35-4059-ba02-7333a24df207 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Action: 'create', calling method: .version_select at 0x7f3176579b80>, body: {"keypair": {"name": "tempest-keypair-66681313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/wP+p6qhEJjGyG6fKbqNjPmmOY+IXhykkXsadpaXip7oYToGmYWz2chMg1J9Q9a/lXsuR0R3aoPYpTjJq4xXaLwm4cYjGvUg8JP5cWE+lhpv4Jk/hAXCJdKkQPvJckcQ=="}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:52:47.540918 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-b0c8d966-2b35-4059-ba02-7333a24df207 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Getting quotas for project f91efa94deff4ceb80b0a1aa88087421. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:52:47.544950 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.quota [None req-b0c8d966-2b35-4059-ba02-7333a24df207 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Getting quotas for user 31b919a031504f2bace596da457b91cf and project f91efa94deff4ceb80b0a1aa88087421. Resources: {'key_pairs'} {{(pid=127617) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:52:47.624158 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-b0c8d966-2b35-4059-ba02-7333a24df207 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.103374 Sep 06 04:52:47.624753 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 647/1310] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Sep 6 04:52:47 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:52:49.838971 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-687983547", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3d940072-d3c6-4a12-b0c8-5039fce3aa0d"}], "security_groups": [{"name": "tempest-securitygroup--778289126"}], "key_name": "tempest-keypair-66681313", "user_data": "}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:52:49.944408 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] validate_networks() for [('3d940072-d3c6-4a12-b0c8-5039fce3aa0d', None, None, None, None, None)] {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:52:50.313059 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:52:50.313519 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:52:50.314000 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:52:50.314408 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:52:50.314816 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:52:50.323603 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:50.324074 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:50.324507 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:50.325221 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:50.325715 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:50.326134 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:50.342493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Getting quotas for project f91efa94deff4ceb80b0a1aa88087421. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:52:50.346449 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Getting quotas for user 31b919a031504f2bace596da457b91cf and project f91efa94deff4ceb80b0a1aa88087421. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:52:50.358184 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:52:50.360458 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:52:50.655463 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-8dd0a86f-c391-49de-a32e-b512ebafb9aa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.821103 Sep 06 04:52:50.656353 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 664/1311] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:52:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:52:50.668634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-94753b5f-ec8f-4c5e-893e-71371b283c92 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:50.669353 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-94753b5f-ec8f-4c5e-893e-71371b283c92 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:50.728046 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-94753b5f-ec8f-4c5e-893e-71371b283c92 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:52:50.735136 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-94753b5f-ec8f-4c5e-893e-71371b283c92 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1235 microversion: 2.1 time: 0.070841 Sep 06 04:52:50.735692 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 648/1312] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:52:50 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1235 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:52:51.758051 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1bff11e2-d1c9-486d-a4cb-f65b32e94471 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:51.758677 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1bff11e2-d1c9-486d-a4cb-f65b32e94471 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:51.764998 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bff11e2-d1c9-486d-a4cb-f65b32e94471 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:51.765531 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bff11e2-d1c9-486d-a4cb-f65b32e94471 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:51.765967 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bff11e2-d1c9-486d-a4cb-f65b32e94471 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:51.766654 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bff11e2-d1c9-486d-a4cb-f65b32e94471 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:51.767112 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bff11e2-d1c9-486d-a4cb-f65b32e94471 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:51.767532 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1bff11e2-d1c9-486d-a4cb-f65b32e94471 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:51.828840 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1bff11e2-d1c9-486d-a4cb-f65b32e94471 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:52:51.837498 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1bff11e2-d1c9-486d-a4cb-f65b32e94471 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1239 microversion: 2.1 time: 0.084007 Sep 06 04:52:51.838123 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 665/1313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:52:51 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1239 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:52:52.860793 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0f6bfa3b-7cf6-4f47-ba73-3f5d4be94843 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:52.861433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0f6bfa3b-7cf6-4f47-ba73-3f5d4be94843 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:52.868949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f6bfa3b-7cf6-4f47-ba73-3f5d4be94843 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:52.869762 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f6bfa3b-7cf6-4f47-ba73-3f5d4be94843 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:52.870191 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f6bfa3b-7cf6-4f47-ba73-3f5d4be94843 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:52.870889 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f6bfa3b-7cf6-4f47-ba73-3f5d4be94843 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:52.871377 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f6bfa3b-7cf6-4f47-ba73-3f5d4be94843 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:52.872030 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0f6bfa3b-7cf6-4f47-ba73-3f5d4be94843 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:52.943328 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0f6bfa3b-7cf6-4f47-ba73-3f5d4be94843 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:52:52.951103 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0f6bfa3b-7cf6-4f47-ba73-3f5d4be94843 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1305 microversion: 2.1 time: 0.094751 Sep 06 04:52:52.951679 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 649/1314] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:52:52 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1305 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:52:53.976153 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-6f5c765e-c70f-499e-bd54-116b63f5323d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:53.976704 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-6f5c765e-c70f-499e-bd54-116b63f5323d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:53.982949 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f5c765e-c70f-499e-bd54-116b63f5323d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:53.983431 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f5c765e-c70f-499e-bd54-116b63f5323d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:53.983860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f5c765e-c70f-499e-bd54-116b63f5323d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:53.984544 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f5c765e-c70f-499e-bd54-116b63f5323d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:53.985026 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f5c765e-c70f-499e-bd54-116b63f5323d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:53.985473 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-6f5c765e-c70f-499e-bd54-116b63f5323d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:54.112021 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-6f5c765e-c70f-499e-bd54-116b63f5323d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:52:54.119760 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-6f5c765e-c70f-499e-bd54-116b63f5323d tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1360 microversion: 2.1 time: 0.148262 Sep 06 04:52:54.120324 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 666/1315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:52:53 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1360 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:52:54.205559 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-20eb2d5e-8d04-4a60-8ff3-7713bd212257 req-75419b5b-d563-4ec8-a7ab-0a8b01b9dc58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a742ba7-30f8-4f46-977e-a92938d6ea02", "tag": "4c405b50-d678-4072-a125-a642f4263bf5"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:52:54.216320 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-20eb2d5e-8d04-4a60-8ff3-7713bd212257 req-75419b5b-d563-4ec8-a7ab-0a8b01b9dc58 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:54.216788 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-20eb2d5e-8d04-4a60-8ff3-7713bd212257 req-75419b5b-d563-4ec8-a7ab-0a8b01b9dc58 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:54.217217 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-20eb2d5e-8d04-4a60-8ff3-7713bd212257 req-75419b5b-d563-4ec8-a7ab-0a8b01b9dc58 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:54.228519 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-20eb2d5e-8d04-4a60-8ff3-7713bd212257 req-75419b5b-d563-4ec8-a7ab-0a8b01b9dc58 service nova] Creating event network-changed:4c405b50-d678-4072-a125-a642f4263bf5 for instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 on hv-cinder-85600 Sep 06 04:52:54.233393 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-20eb2d5e-8d04-4a60-8ff3-7713bd212257 req-75419b5b-d563-4ec8-a7ab-0a8b01b9dc58 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031567 Sep 06 04:52:54.233980 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 650/1316] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:52:55.142838 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d02e5b0e-a8a0-44cd-8728-0be2af1824da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:55.143447 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d02e5b0e-a8a0-44cd-8728-0be2af1824da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:55.150396 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d02e5b0e-a8a0-44cd-8728-0be2af1824da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:55.150914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d02e5b0e-a8a0-44cd-8728-0be2af1824da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:55.151352 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d02e5b0e-a8a0-44cd-8728-0be2af1824da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:55.152042 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d02e5b0e-a8a0-44cd-8728-0be2af1824da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:55.152499 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d02e5b0e-a8a0-44cd-8728-0be2af1824da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:55.152923 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d02e5b0e-a8a0-44cd-8728-0be2af1824da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:55.288429 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d02e5b0e-a8a0-44cd-8728-0be2af1824da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:52:55.296034 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d02e5b0e-a8a0-44cd-8728-0be2af1824da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1360 microversion: 2.1 time: 0.157063 Sep 06 04:52:55.296598 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 667/1317] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:52:55 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:52:56.320719 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-1f44e94d-4bef-4819-b0ae-1cd24260c853 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:56.321430 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-1f44e94d-4bef-4819-b0ae-1cd24260c853 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:56.327473 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f44e94d-4bef-4819-b0ae-1cd24260c853 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:56.327947 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f44e94d-4bef-4819-b0ae-1cd24260c853 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:56.328373 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f44e94d-4bef-4819-b0ae-1cd24260c853 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:56.329096 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f44e94d-4bef-4819-b0ae-1cd24260c853 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:56.329562 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f44e94d-4bef-4819-b0ae-1cd24260c853 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:56.334061 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-1f44e94d-4bef-4819-b0ae-1cd24260c853 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:56.459747 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-1f44e94d-4bef-4819-b0ae-1cd24260c853 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:52:56.467368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-1f44e94d-4bef-4819-b0ae-1cd24260c853 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1360 microversion: 2.1 time: 0.151880 Sep 06 04:52:56.467936 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 651/1318] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:52:56 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:52:57.490144 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a26ec129-6ee2-4878-846e-7c6658a34e99 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:57.491269 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a26ec129-6ee2-4878-846e-7c6658a34e99 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:57.497639 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a26ec129-6ee2-4878-846e-7c6658a34e99 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:57.498117 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a26ec129-6ee2-4878-846e-7c6658a34e99 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:57.498543 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a26ec129-6ee2-4878-846e-7c6658a34e99 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:57.499222 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a26ec129-6ee2-4878-846e-7c6658a34e99 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:57.499697 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a26ec129-6ee2-4878-846e-7c6658a34e99 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:57.500086 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a26ec129-6ee2-4878-846e-7c6658a34e99 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:57.631967 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a26ec129-6ee2-4878-846e-7c6658a34e99 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:52:57.639630 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a26ec129-6ee2-4878-846e-7c6658a34e99 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1360 microversion: 2.1 time: 0.153362 Sep 06 04:52:57.640137 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 668/1319] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:52:57 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:52:58.663464 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-5812b5a5-01d5-4720-882b-1ce40680f1a8 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:58.664102 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-5812b5a5-01d5-4720-882b-1ce40680f1a8 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:58.670798 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5812b5a5-01d5-4720-882b-1ce40680f1a8 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:58.671282 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5812b5a5-01d5-4720-882b-1ce40680f1a8 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:58.671720 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5812b5a5-01d5-4720-882b-1ce40680f1a8 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:58.672407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5812b5a5-01d5-4720-882b-1ce40680f1a8 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:58.672856 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5812b5a5-01d5-4720-882b-1ce40680f1a8 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:58.673278 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-5812b5a5-01d5-4720-882b-1ce40680f1a8 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:58.798495 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-5812b5a5-01d5-4720-882b-1ce40680f1a8 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:52:58.807031 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-5812b5a5-01d5-4720-882b-1ce40680f1a8 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1360 microversion: 2.1 time: 0.148166 Sep 06 04:52:58.807600 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 652/1320] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:52:58 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:52:59.829488 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3a171f30-9428-43c8-a9ed-22eb1366642c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:52:59.830239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3a171f30-9428-43c8-a9ed-22eb1366642c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:52:59.837123 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a171f30-9428-43c8-a9ed-22eb1366642c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:59.837667 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a171f30-9428-43c8-a9ed-22eb1366642c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:59.844043 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a171f30-9428-43c8-a9ed-22eb1366642c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:59.844043 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a171f30-9428-43c8-a9ed-22eb1366642c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:52:59.844043 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a171f30-9428-43c8-a9ed-22eb1366642c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:52:59.844043 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3a171f30-9428-43c8-a9ed-22eb1366642c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:52:59.969085 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-3a171f30-9428-43c8-a9ed-22eb1366642c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:52:59.977146 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3a171f30-9428-43c8-a9ed-22eb1366642c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1360 microversion: 2.1 time: 0.151541 Sep 06 04:52:59.977734 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 669/1321] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:52:59 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:53:01.001337 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d10db803-e109-4c6f-aa21-e12789e5a2bc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:53:01.001955 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d10db803-e109-4c6f-aa21-e12789e5a2bc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:53:01.004333 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=6 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:53:01.009497 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d10db803-e109-4c6f-aa21-e12789e5a2bc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:53:01.012443 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d10db803-e109-4c6f-aa21-e12789e5a2bc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:53:01.012443 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d10db803-e109-4c6f-aa21-e12789e5a2bc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:53:01.012443 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d10db803-e109-4c6f-aa21-e12789e5a2bc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:53:01.012443 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d10db803-e109-4c6f-aa21-e12789e5a2bc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:53:01.012833 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d10db803-e109-4c6f-aa21-e12789e5a2bc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:53:01.144044 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-d10db803-e109-4c6f-aa21-e12789e5a2bc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:53:01.153274 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d10db803-e109-4c6f-aa21-e12789e5a2bc tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1360 microversion: 2.1 time: 0.155777 Sep 06 04:53:01.153872 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 653/1322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:53:00 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1360 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:53:01.321182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-4ebcd36e-3ac3-48d3-8f99-5a46b8a426be req-7cca7395-29f5-4043-8a6a-648fb40aec1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a742ba7-30f8-4f46-977e-a92938d6ea02", "name": "network-vif-plugged", "status": "completed", "tag": "4c405b50-d678-4072-a125-a642f4263bf5"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:53:01.326160 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:53:01.326811 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:53:01.332462 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-4ebcd36e-3ac3-48d3-8f99-5a46b8a426be req-7cca7395-29f5-4043-8a6a-648fb40aec1f service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:53:01.332880 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-4ebcd36e-3ac3-48d3-8f99-5a46b8a426be req-7cca7395-29f5-4043-8a6a-648fb40aec1f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:53:01.333467 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-4ebcd36e-3ac3-48d3-8f99-5a46b8a426be req-7cca7395-29f5-4043-8a6a-648fb40aec1f service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:53:01.345384 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-4ebcd36e-3ac3-48d3-8f99-5a46b8a426be req-7cca7395-29f5-4043-8a6a-648fb40aec1f service nova] Creating event network-vif-plugged:4c405b50-d678-4072-a125-a642f4263bf5 for instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 on hv-cinder-85600 Sep 06 04:53:01.350675 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-4ebcd36e-3ac3-48d3-8f99-5a46b8a426be req-7cca7395-29f5-4043-8a6a-648fb40aec1f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033943 Sep 06 04:53:01.351268 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 670/1323] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:53:02.180465 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0ce1792f-7104-4368-92d2-a72b1feb64cb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:53:02.181069 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0ce1792f-7104-4368-92d2-a72b1feb64cb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:53:02.187452 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ce1792f-7104-4368-92d2-a72b1feb64cb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:53:02.189917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ce1792f-7104-4368-92d2-a72b1feb64cb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:53:02.189917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ce1792f-7104-4368-92d2-a72b1feb64cb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:53:02.189917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ce1792f-7104-4368-92d2-a72b1feb64cb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:53:02.189917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ce1792f-7104-4368-92d2-a72b1feb64cb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:53:02.190338 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0ce1792f-7104-4368-92d2-a72b1feb64cb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:53:02.320469 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0ce1792f-7104-4368-92d2-a72b1feb64cb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:53:02.328203 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0ce1792f-7104-4368-92d2-a72b1feb64cb tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1360 microversion: 2.1 time: 0.152186 Sep 06 04:53:02.328763 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 654/1324] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:53:02 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:53:03.353782 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-dcbf4c1a-3cb7-4d08-9333-0531881ca939 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:53:03.354499 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-dcbf4c1a-3cb7-4d08-9333-0531881ca939 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:53:03.360993 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcbf4c1a-3cb7-4d08-9333-0531881ca939 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:53:03.361501 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcbf4c1a-3cb7-4d08-9333-0531881ca939 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:53:03.361982 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcbf4c1a-3cb7-4d08-9333-0531881ca939 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:53:03.369739 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcbf4c1a-3cb7-4d08-9333-0531881ca939 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:53:03.369739 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcbf4c1a-3cb7-4d08-9333-0531881ca939 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:53:03.369739 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-dcbf4c1a-3cb7-4d08-9333-0531881ca939 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:53:03.492977 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-dcbf4c1a-3cb7-4d08-9333-0531881ca939 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:53:03.501054 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-dcbf4c1a-3cb7-4d08-9333-0531881ca939 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1360 microversion: 2.1 time: 0.153753 Sep 06 04:53:03.501668 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 671/1325] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:53:03 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:53:04.523947 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7642ead2-0801-49cd-96ee-018aa6224881 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:53:04.524552 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7642ead2-0801-49cd-96ee-018aa6224881 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:53:04.530976 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7642ead2-0801-49cd-96ee-018aa6224881 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:53:04.531427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7642ead2-0801-49cd-96ee-018aa6224881 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:53:04.531853 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7642ead2-0801-49cd-96ee-018aa6224881 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:53:04.532529 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7642ead2-0801-49cd-96ee-018aa6224881 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:53:04.533241 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7642ead2-0801-49cd-96ee-018aa6224881 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:53:04.533682 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7642ead2-0801-49cd-96ee-018aa6224881 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:53:04.663154 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7642ead2-0801-49cd-96ee-018aa6224881 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:53:04.670933 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7642ead2-0801-49cd-96ee-018aa6224881 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1547 microversion: 2.1 time: 0.151122 Sep 06 04:53:04.671509 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 655/1326] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:53:04 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:53:04.692886 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ef6eda06-c70d-418f-ae9c-00f21278076c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:53:04.693458 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ef6eda06-c70d-418f-ae9c-00f21278076c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:53:04.700214 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef6eda06-c70d-418f-ae9c-00f21278076c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:53:04.700699 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef6eda06-c70d-418f-ae9c-00f21278076c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:53:04.701139 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef6eda06-c70d-418f-ae9c-00f21278076c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:53:04.701887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef6eda06-c70d-418f-ae9c-00f21278076c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:53:04.702336 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef6eda06-c70d-418f-ae9c-00f21278076c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:53:04.702762 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ef6eda06-c70d-418f-ae9c-00f21278076c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:53:04.778071 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ef6eda06-c70d-418f-ae9c-00f21278076c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088978 Sep 06 04:53:04.778703 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 672/1327] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Sep 6 04:53:04 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:53:05.798305 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-a8b59a18-cb63-4440-9cde-46f8e4f10b41 req-65922848-8707-40c1-bcde-d2f094d96b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a742ba7-30f8-4f46-977e-a92938d6ea02", "tag": "4c405b50-d678-4072-a125-a642f4263bf5"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:53:05.808194 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a8b59a18-cb63-4440-9cde-46f8e4f10b41 req-65922848-8707-40c1-bcde-d2f094d96b42 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:53:05.808663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a8b59a18-cb63-4440-9cde-46f8e4f10b41 req-65922848-8707-40c1-bcde-d2f094d96b42 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:53:05.809083 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-a8b59a18-cb63-4440-9cde-46f8e4f10b41 req-65922848-8707-40c1-bcde-d2f094d96b42 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:53:05.823040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-a8b59a18-cb63-4440-9cde-46f8e4f10b41 req-65922848-8707-40c1-bcde-d2f094d96b42 service nova] Creating event network-changed:4c405b50-d678-4072-a125-a642f4263bf5 for instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 on hv-cinder-85600 Sep 06 04:53:05.828119 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-a8b59a18-cb63-4440-9cde-46f8e4f10b41 req-65922848-8707-40c1-bcde-d2f094d96b42 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033693 Sep 06 04:53:05.829395 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 656/1328] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:54:21.077604 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:54:21.078371 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=70 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:54:21.214855 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-58d8a439-c973-440c-bcd2-42d1b8ab80d2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:21.215357 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-58d8a439-c973-440c-bcd2-42d1b8ab80d2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:21.221293 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58d8a439-c973-440c-bcd2-42d1b8ab80d2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:21.221814 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58d8a439-c973-440c-bcd2-42d1b8ab80d2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:21.222312 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58d8a439-c973-440c-bcd2-42d1b8ab80d2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:21.223451 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58d8a439-c973-440c-bcd2-42d1b8ab80d2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:21.224167 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58d8a439-c973-440c-bcd2-42d1b8ab80d2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:21.224597 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-58d8a439-c973-440c-bcd2-42d1b8ab80d2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:21.248813 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-58d8a439-c973-440c-bcd2-42d1b8ab80d2 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/ips" status: 200 len: 147 microversion: 2.1 time: 0.173947 Sep 06 04:54:21.249396 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 673/1329] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Sep 6 04:54:21 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/ips => generated 147 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:54:23.917476 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 04:54:23.917970 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Tue Sep 6 04:54:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments (ip 10.222.0.30) !!! Sep 06 04:54:23.919582 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:54:23.920312 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:54:23.930494 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-dc5accb1-0ed5-4b2f-ab7e-24277c8b6603 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83bbef55-8a74-4fd4-91ef-b47280423008"}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:54:23.934054 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-dc5accb1-0ed5-4b2f-ab7e-24277c8b6603 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:23.938985 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc5accb1-0ed5-4b2f-ab7e-24277c8b6603 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:23.939461 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc5accb1-0ed5-4b2f-ab7e-24277c8b6603 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:23.939898 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc5accb1-0ed5-4b2f-ab7e-24277c8b6603 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:23.940583 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc5accb1-0ed5-4b2f-ab7e-24277c8b6603 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:23.941037 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc5accb1-0ed5-4b2f-ab7e-24277c8b6603 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:23.941495 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-dc5accb1-0ed5-4b2f-ab7e-24277c8b6603 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:24.705040 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-dc5accb1-0ed5-4b2f-ab7e-24277c8b6603 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "POST /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.789838 Sep 06 04:54:24.705696 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 657/1330] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Sep 6 04:54:23 2022] POST /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments => generated 194 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:54:32.232129 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-686de4df-0f1a-4211-a2c2-693e79a248ae tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:32.234416 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-686de4df-0f1a-4211-a2c2-693e79a248ae tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:32.237822 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:54:32.238464 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=4 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:54:32.241871 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-686de4df-0f1a-4211-a2c2-693e79a248ae tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:32.242381 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-686de4df-0f1a-4211-a2c2-693e79a248ae tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:32.242815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-686de4df-0f1a-4211-a2c2-693e79a248ae tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:32.244005 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-686de4df-0f1a-4211-a2c2-693e79a248ae tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:32.244815 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-686de4df-0f1a-4211-a2c2-693e79a248ae tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:32.245265 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-686de4df-0f1a-4211-a2c2-693e79a248ae tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:32.276358 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-686de4df-0f1a-4211-a2c2-693e79a248ae tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048199 Sep 06 04:54:32.276921 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 674/1331] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:54:32 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:54:32.288351 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-eab1eb79-fd22-40c5-8549-ebfc711dfe41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:32.288923 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-eab1eb79-fd22-40c5-8549-ebfc711dfe41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:32.296158 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eab1eb79-fd22-40c5-8549-ebfc711dfe41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:32.296635 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eab1eb79-fd22-40c5-8549-ebfc711dfe41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:32.297176 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eab1eb79-fd22-40c5-8549-ebfc711dfe41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:32.297893 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eab1eb79-fd22-40c5-8549-ebfc711dfe41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:32.298342 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eab1eb79-fd22-40c5-8549-ebfc711dfe41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:32.298755 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-eab1eb79-fd22-40c5-8549-ebfc711dfe41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:32.327407 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-eab1eb79-fd22-40c5-8549-ebfc711dfe41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments/83bbef55-8a74-4fd4-91ef-b47280423008" status: 200 len: 194 microversion: 2.1 time: 0.043541 Sep 06 04:54:32.327974 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 658/1332] 10.222.0.30 () {58 vars in 1413 bytes} [Tue Sep 6 04:54:32 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments/83bbef55-8a74-4fd4-91ef-b47280423008 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:54:33.966898 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-346bfebf-acb0-4d0e-9734-0ff0d82b2d50 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6bde686-4a16-4700-b834-f0ed2367c68a"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:54:33.969245 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-346bfebf-acb0-4d0e-9734-0ff0d82b2d50 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:33.976050 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-346bfebf-acb0-4d0e-9734-0ff0d82b2d50 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:33.976535 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-346bfebf-acb0-4d0e-9734-0ff0d82b2d50 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:33.977716 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-346bfebf-acb0-4d0e-9734-0ff0d82b2d50 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:33.977716 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-346bfebf-acb0-4d0e-9734-0ff0d82b2d50 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:33.978923 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-346bfebf-acb0-4d0e-9734-0ff0d82b2d50 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:33.979348 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-346bfebf-acb0-4d0e-9734-0ff0d82b2d50 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:34.762491 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-346bfebf-acb0-4d0e-9734-0ff0d82b2d50 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "POST /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.800192 Sep 06 04:54:34.763106 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 675/1333] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Sep 6 04:54:33 2022] POST /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments => generated 194 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:54:43.347585 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7b39abbd-18ef-41f7-b09b-14f666359977 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:43.349832 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7b39abbd-18ef-41f7-b09b-14f666359977 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:43.352268 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=4 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:54:43.353710 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:54:43.358269 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b39abbd-18ef-41f7-b09b-14f666359977 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:43.362669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b39abbd-18ef-41f7-b09b-14f666359977 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:43.362669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b39abbd-18ef-41f7-b09b-14f666359977 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:43.362669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b39abbd-18ef-41f7-b09b-14f666359977 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:43.362669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b39abbd-18ef-41f7-b09b-14f666359977 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:43.363109 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7b39abbd-18ef-41f7-b09b-14f666359977 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:43.391855 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7b39abbd-18ef-41f7-b09b-14f666359977 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048080 Sep 06 04:54:43.392427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 659/1334] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:54:43 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:54:43.537785 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a3e364e8-28b8-44f9-bb7f-a81e8b3657c0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:43.538354 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a3e364e8-28b8-44f9-bb7f-a81e8b3657c0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:43.545097 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3e364e8-28b8-44f9-bb7f-a81e8b3657c0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:43.545609 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3e364e8-28b8-44f9-bb7f-a81e8b3657c0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:43.546044 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3e364e8-28b8-44f9-bb7f-a81e8b3657c0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:43.546728 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3e364e8-28b8-44f9-bb7f-a81e8b3657c0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:43.547176 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3e364e8-28b8-44f9-bb7f-a81e8b3657c0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:43.547593 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a3e364e8-28b8-44f9-bb7f-a81e8b3657c0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:43.578492 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a3e364e8-28b8-44f9-bb7f-a81e8b3657c0 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments/83bbef55-8a74-4fd4-91ef-b47280423008" status: 200 len: 194 microversion: 2.1 time: 0.045906 Sep 06 04:54:43.579066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 676/1335] 10.222.0.30 () {58 vars in 1413 bytes} [Tue Sep 6 04:54:43 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments/83bbef55-8a74-4fd4-91ef-b47280423008 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:54:43.589901 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ce056d5a-65bd-4932-83f4-7221f185dc12 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:43.590388 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ce056d5a-65bd-4932-83f4-7221f185dc12 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:43.596550 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce056d5a-65bd-4932-83f4-7221f185dc12 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:43.597022 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce056d5a-65bd-4932-83f4-7221f185dc12 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:43.597489 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce056d5a-65bd-4932-83f4-7221f185dc12 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:43.598324 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce056d5a-65bd-4932-83f4-7221f185dc12 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:43.599572 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce056d5a-65bd-4932-83f4-7221f185dc12 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:43.599993 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ce056d5a-65bd-4932-83f4-7221f185dc12 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:43.684382 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-ce056d5a-65bd-4932-83f4-7221f185dc12 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lazy-loading 'services' on Instance uuid 4a742ba7-30f8-4f46-977e-a92938d6ea02 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:54:43.866249 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ce056d5a-65bd-4932-83f4-7221f185dc12 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments/83bbef55-8a74-4fd4-91ef-b47280423008" status: 202 len: 0 microversion: 2.1 time: 0.280719 Sep 06 04:54:43.867153 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 660/1336] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Sep 6 04:54:43 2022] DELETE /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments/83bbef55-8a74-4fd4-91ef-b47280423008 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:54:46.047708 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-0b899f0a-7faf-4fb6-8560-08311d61e7da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:46.048202 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-0b899f0a-7faf-4fb6-8560-08311d61e7da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:46.054593 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b899f0a-7faf-4fb6-8560-08311d61e7da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:46.055072 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b899f0a-7faf-4fb6-8560-08311d61e7da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:46.055511 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b899f0a-7faf-4fb6-8560-08311d61e7da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:46.056834 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b899f0a-7faf-4fb6-8560-08311d61e7da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:46.057295 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b899f0a-7faf-4fb6-8560-08311d61e7da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:46.057747 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-0b899f0a-7faf-4fb6-8560-08311d61e7da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:46.086368 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-0b899f0a-7faf-4fb6-8560-08311d61e7da tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments/d6bde686-4a16-4700-b834-f0ed2367c68a" status: 200 len: 194 microversion: 2.1 time: 0.042586 Sep 06 04:54:46.088034 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 677/1337] 10.222.0.30 () {58 vars in 1413 bytes} [Tue Sep 6 04:54:46 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments/d6bde686-4a16-4700-b834-f0ed2367c68a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:54:46.098916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-35cc5c75-d4fe-438a-949b-2547aa9b685e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:46.099493 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-35cc5c75-d4fe-438a-949b-2547aa9b685e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:46.105874 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35cc5c75-d4fe-438a-949b-2547aa9b685e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:46.106353 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35cc5c75-d4fe-438a-949b-2547aa9b685e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:46.106784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35cc5c75-d4fe-438a-949b-2547aa9b685e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:46.107468 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35cc5c75-d4fe-438a-949b-2547aa9b685e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:46.107930 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35cc5c75-d4fe-438a-949b-2547aa9b685e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:46.108334 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-35cc5c75-d4fe-438a-949b-2547aa9b685e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:46.187634 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-35cc5c75-d4fe-438a-949b-2547aa9b685e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lazy-loading 'services' on Instance uuid 4a742ba7-30f8-4f46-977e-a92938d6ea02 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:54:46.368830 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-35cc5c75-d4fe-438a-949b-2547aa9b685e tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments/d6bde686-4a16-4700-b834-f0ed2367c68a" status: 202 len: 0 microversion: 2.1 time: 0.274387 Sep 06 04:54:46.369498 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 661/1338] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Sep 6 04:54:46 2022] DELETE /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments/d6bde686-4a16-4700-b834-f0ed2367c68a => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:54:47.544347 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-4fbf48a7-4578-4818-82c9-219d1104f3cd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:47.546477 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-4fbf48a7-4578-4818-82c9-219d1104f3cd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:47.552801 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4fbf48a7-4578-4818-82c9-219d1104f3cd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:47.553280 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4fbf48a7-4578-4818-82c9-219d1104f3cd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:47.553745 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4fbf48a7-4578-4818-82c9-219d1104f3cd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:47.554432 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4fbf48a7-4578-4818-82c9-219d1104f3cd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:47.554887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4fbf48a7-4578-4818-82c9-219d1104f3cd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:47.555319 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-4fbf48a7-4578-4818-82c9-219d1104f3cd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:47.584508 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-4fbf48a7-4578-4818-82c9-219d1104f3cd tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044130 Sep 06 04:54:47.585055 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 678/1339] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:54:47 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 04:54:47.699913 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-6fd151b4-5202-41dc-94c3-5c283eb08d41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:47.702160 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-6fd151b4-5202-41dc-94c3-5c283eb08d41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:47.708626 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fd151b4-5202-41dc-94c3-5c283eb08d41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:47.709106 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fd151b4-5202-41dc-94c3-5c283eb08d41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:47.709575 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fd151b4-5202-41dc-94c3-5c283eb08d41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:47.710253 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fd151b4-5202-41dc-94c3-5c283eb08d41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:47.710703 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fd151b4-5202-41dc-94c3-5c283eb08d41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:47.711119 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-6fd151b4-5202-41dc-94c3-5c283eb08d41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:47.739284 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-6fd151b4-5202-41dc-94c3-5c283eb08d41 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044168 Sep 06 04:54:47.739823 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 662/1340] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Sep 6 04:54:47 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 06 04:54:47.806500 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9154d030-c99f-4efe-9fe2-6c9d8c289a24 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:47.806997 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9154d030-c99f-4efe-9fe2-6c9d8c289a24 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:47.812986 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9154d030-c99f-4efe-9fe2-6c9d8c289a24 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:47.813514 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9154d030-c99f-4efe-9fe2-6c9d8c289a24 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:47.813951 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9154d030-c99f-4efe-9fe2-6c9d8c289a24 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:47.814637 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9154d030-c99f-4efe-9fe2-6c9d8c289a24 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:47.815095 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9154d030-c99f-4efe-9fe2-6c9d8c289a24 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:47.815520 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9154d030-c99f-4efe-9fe2-6c9d8c289a24 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:47.840446 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9154d030-c99f-4efe-9fe2-6c9d8c289a24 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Going to try to terminate instance {{(pid=127618) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:54:48.117113 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9154d030-c99f-4efe-9fe2-6c9d8c289a24 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 204 len: 0 microversion: 2.1 time: 0.314754 Sep 06 04:54:48.117648 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 679/1341] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:54:47 2022] DELETE /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:54:48.125873 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-bebe3f8b-fcd6-46d9-8631-12828baaed6b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:48.126489 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-bebe3f8b-fcd6-46d9-8631-12828baaed6b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:48.134300 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bebe3f8b-fcd6-46d9-8631-12828baaed6b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:48.134795 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bebe3f8b-fcd6-46d9-8631-12828baaed6b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:48.135263 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bebe3f8b-fcd6-46d9-8631-12828baaed6b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:48.135936 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bebe3f8b-fcd6-46d9-8631-12828baaed6b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:48.136380 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bebe3f8b-fcd6-46d9-8631-12828baaed6b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:48.136796 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-bebe3f8b-fcd6-46d9-8631-12828baaed6b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:48.266427 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-bebe3f8b-fcd6-46d9-8631-12828baaed6b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:54:48.274149 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-bebe3f8b-fcd6-46d9-8631-12828baaed6b tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1672 microversion: 2.1 time: 0.152206 Sep 06 04:54:48.274840 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 663/1342] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:54:48 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:54:49.297893 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-86702208-8643-4f19-989c-b01e7d0b2fc7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:49.298591 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-86702208-8643-4f19-989c-b01e7d0b2fc7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:49.304993 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-86702208-8643-4f19-989c-b01e7d0b2fc7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:49.306006 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-86702208-8643-4f19-989c-b01e7d0b2fc7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:49.306971 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-86702208-8643-4f19-989c-b01e7d0b2fc7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:49.307667 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-86702208-8643-4f19-989c-b01e7d0b2fc7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:49.308122 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-86702208-8643-4f19-989c-b01e7d0b2fc7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:49.308546 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-86702208-8643-4f19-989c-b01e7d0b2fc7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:49.449202 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-86702208-8643-4f19-989c-b01e7d0b2fc7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:54:49.456908 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-86702208-8643-4f19-989c-b01e7d0b2fc7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1672 microversion: 2.1 time: 0.163269 Sep 06 04:54:49.457491 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 680/1343] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:54:49 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:54:50.480230 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4caa1cc4-74c4-4668-969c-d6f8d8e3cbfa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:50.480828 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4caa1cc4-74c4-4668-969c-d6f8d8e3cbfa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:50.487531 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4caa1cc4-74c4-4668-969c-d6f8d8e3cbfa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:50.488021 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4caa1cc4-74c4-4668-969c-d6f8d8e3cbfa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:50.488453 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4caa1cc4-74c4-4668-969c-d6f8d8e3cbfa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:50.489164 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4caa1cc4-74c4-4668-969c-d6f8d8e3cbfa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:50.489644 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4caa1cc4-74c4-4668-969c-d6f8d8e3cbfa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:50.490065 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4caa1cc4-74c4-4668-969c-d6f8d8e3cbfa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:50.944384 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4caa1cc4-74c4-4668-969c-d6f8d8e3cbfa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:54:50.952967 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4caa1cc4-74c4-4668-969c-d6f8d8e3cbfa tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1672 microversion: 2.1 time: 0.476815 Sep 06 04:54:50.953572 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 664/1344] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:54:50 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1672 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:54:51.424636 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-cf805bc0-fb74-44a0-8b3b-fef2fe710e2f req-b8b16793-b95f-4023-82f3-f9ca46e1dff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a742ba7-30f8-4f46-977e-a92938d6ea02", "name": "network-vif-deleted", "tag": "4c405b50-d678-4072-a125-a642f4263bf5"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:54:51.435140 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-cf805bc0-fb74-44a0-8b3b-fef2fe710e2f req-b8b16793-b95f-4023-82f3-f9ca46e1dff1 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:51.435712 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-cf805bc0-fb74-44a0-8b3b-fef2fe710e2f req-b8b16793-b95f-4023-82f3-f9ca46e1dff1 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:51.436137 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-cf805bc0-fb74-44a0-8b3b-fef2fe710e2f req-b8b16793-b95f-4023-82f3-f9ca46e1dff1 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:51.448751 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-cf805bc0-fb74-44a0-8b3b-fef2fe710e2f req-b8b16793-b95f-4023-82f3-f9ca46e1dff1 service nova] Creating event network-vif-deleted:4c405b50-d678-4072-a125-a642f4263bf5 for instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 on hv-cinder-85600 Sep 06 04:54:51.454153 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-cf805bc0-fb74-44a0-8b3b-fef2fe710e2f req-b8b16793-b95f-4023-82f3-f9ca46e1dff1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033461 Sep 06 04:54:51.454756 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 681/1345] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:54:51.975936 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-0d7ff40e-d2c2-4466-91f3-e26777af7e49 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:51.976547 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-0d7ff40e-d2c2-4466-91f3-e26777af7e49 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:51.983693 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d7ff40e-d2c2-4466-91f3-e26777af7e49 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:51.984180 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d7ff40e-d2c2-4466-91f3-e26777af7e49 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:51.984623 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d7ff40e-d2c2-4466-91f3-e26777af7e49 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:51.985335 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d7ff40e-d2c2-4466-91f3-e26777af7e49 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:51.985794 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d7ff40e-d2c2-4466-91f3-e26777af7e49 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:51.986215 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d7ff40e-d2c2-4466-91f3-e26777af7e49 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:52.017970 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d7ff40e-d2c2-4466-91f3-e26777af7e49 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:52.018450 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d7ff40e-d2c2-4466-91f3-e26777af7e49 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:52.018884 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-0d7ff40e-d2c2-4466-91f3-e26777af7e49 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:52.019331 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-0d7ff40e-d2c2-4466-91f3-e26777af7e49 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lazy-loading 'fault' on Instance uuid 4a742ba7-30f8-4f46-977e-a92938d6ea02 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:54:52.059343 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-0d7ff40e-d2c2-4466-91f3-e26777af7e49 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31b919a031504f2bace596da457b91cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f91efa94deff4ceb80b0a1aa88087421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:54:52.067063 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-0d7ff40e-d2c2-4466-91f3-e26777af7e49 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 200 len: 1325 microversion: 2.1 time: 0.094927 Sep 06 04:54:52.067647 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 665/1346] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:54:51 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 1325 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:54:53.092182 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3e8ba998-e568-4996-a646-f80890884b47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:53.092884 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-3e8ba998-e568-4996-a646-f80890884b47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:53.099064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e8ba998-e568-4996-a646-f80890884b47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:53.099541 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e8ba998-e568-4996-a646-f80890884b47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:53.099972 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e8ba998-e568-4996-a646-f80890884b47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:53.100654 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e8ba998-e568-4996-a646-f80890884b47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:53.101103 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e8ba998-e568-4996-a646-f80890884b47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:53.101558 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-3e8ba998-e568-4996-a646-f80890884b47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:53.115329 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-3e8ba998-e568-4996-a646-f80890884b47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] HTTP exception thrown: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3e8ba998-e568-4996-a646-f80890884b47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Request method failure captured: Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 HTTP/1.1 Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFtEa2RBYoPpw4bA3Ri0CxPZTQv5LG8ZoPb13IV3KJ6KLHQQpUoBvxRTZJCZThdHULwdjirVwlyQa7QQhPioROjFHkWCl1HaAiVxA9HU-pT7jwUisehEZgoSuodsCYUx-a1gWdAU1qpflC9UemjYRl6MpmpXUUTGxEvV4jidAOjbUORU Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: f91efa94deff4ceb80b0a1aa88087421 Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:54:53.116912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:54:53.119066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:54:53.119066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:54:53.119066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: f91efa94deff4ceb80b0a1aa88087421 Sep 06 04:54:53.119066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:54:53.119066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeTestJSON-1376563755-project Sep 06 04:54:53.119066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:54:53.119066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:54:53.119066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 31b919a031504f2bace596da457b91cf Sep 06 04:54:53.119066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeTestJSON-1376563755-project Sep 06 04:54:53.119066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:54:53.119066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. Sep 06 04:54:53.119066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '4a742ba7-30f8-4f46-977e-a92938d6ea02'} Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:54:53.120255 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. Sep 06 04:54:53.121995 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:54:53.123803 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-3e8ba998-e568-4996-a646-f80890884b47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Returning 404 to user: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:54:53.123803 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-3e8ba998-e568-4996-a646-f80890884b47 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 404 len: 111 microversion: 2.1 time: 0.031726 Sep 06 04:54:53.123803 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 682/1347] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:54:53 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:54:53.127307 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-60b560a0-21f4-488c-9d34-1db93004e01c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '.version_select at 0x7f3176663ee0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:53.216174 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-60b560a0-21f4-488c-9d34-1db93004e01c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-66681313" status: 202 len: 0 microversion: 2.1 time: 0.092525 Sep 06 04:54:53.216754 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 666/1348] 10.222.0.30 () {58 vars in 1215 bytes} [Tue Sep 6 04:54:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-66681313 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 06 04:54:56.466560 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9d0c8635-2e44-4847-88f1-4925df30626f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:56.467067 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-9d0c8635-2e44-4847-88f1-4925df30626f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:56.473928 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d0c8635-2e44-4847-88f1-4925df30626f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:56.474406 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d0c8635-2e44-4847-88f1-4925df30626f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:56.474844 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d0c8635-2e44-4847-88f1-4925df30626f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:56.475526 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d0c8635-2e44-4847-88f1-4925df30626f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:56.475980 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d0c8635-2e44-4847-88f1-4925df30626f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:56.476401 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-9d0c8635-2e44-4847-88f1-4925df30626f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:56.489928 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-9d0c8635-2e44-4847-88f1-4925df30626f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] HTTP exception thrown: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9d0c8635-2e44-4847-88f1-4925df30626f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Request method failure captured: Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 HTTP/1.1 Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFtEa2RBYoPpw4bA3Ri0CxPZTQv5LG8ZoPb13IV3KJ6KLHQQpUoBvxRTZJCZThdHULwdjirVwlyQa7QQhPioROjFHkWCl1HaAiVxA9HU-pT7jwUisehEZgoSuodsCYUx-a1gWdAU1qpflC9UemjYRl6MpmpXUUTGxEvV4jidAOjbUORU Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: f91efa94deff4ceb80b0a1aa88087421 Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:54:56.491455 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:54:56.493969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:54:56.493969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:54:56.493969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: f91efa94deff4ceb80b0a1aa88087421 Sep 06 04:54:56.493969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:54:56.493969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeTestJSON-1376563755-project Sep 06 04:54:56.493969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:54:56.493969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:54:56.493969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 31b919a031504f2bace596da457b91cf Sep 06 04:54:56.493969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeTestJSON-1376563755-project Sep 06 04:54:56.493969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:54:56.493969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. Sep 06 04:54:56.493969 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '4a742ba7-30f8-4f46-977e-a92938d6ea02'} Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:54:56.494956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. Sep 06 04:54:56.496605 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:54:56.498253 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-9d0c8635-2e44-4847-88f1-4925df30626f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Returning 404 to user: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:54:56.498253 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9d0c8635-2e44-4847-88f1-4925df30626f tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "DELETE /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 404 len: 111 microversion: 2.1 time: 0.030095 Sep 06 04:54:56.498253 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 683/1349] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:54:56 2022] DELETE /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 06 04:54:56.501969 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d8b26090-ad6e-4c92-adbf-7d0f4a65deb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:56.502578 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-d8b26090-ad6e-4c92-adbf-7d0f4a65deb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 4a742ba7-30f8-4f46-977e-a92938d6ea02] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:56.509989 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8b26090-ad6e-4c92-adbf-7d0f4a65deb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:56.510472 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8b26090-ad6e-4c92-adbf-7d0f4a65deb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:56.510909 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8b26090-ad6e-4c92-adbf-7d0f4a65deb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:56.511618 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8b26090-ad6e-4c92-adbf-7d0f4a65deb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:56.512043 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8b26090-ad6e-4c92-adbf-7d0f4a65deb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:56.512462 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-d8b26090-ad6e-4c92-adbf-7d0f4a65deb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:56.525567 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-d8b26090-ad6e-4c92-adbf-7d0f4a65deb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] HTTP exception thrown: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d8b26090-ad6e-4c92-adbf-7d0f4a65deb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Request method failure captured: Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 HTTP/1.1 Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFtEa2RBYoPpw4bA3Ri0CxPZTQv5LG8ZoPb13IV3KJ6KLHQQpUoBvxRTZJCZThdHULwdjirVwlyQa7QQhPioROjFHkWCl1HaAiVxA9HU-pT7jwUisehEZgoSuodsCYUx-a1gWdAU1qpflC9UemjYRl6MpmpXUUTGxEvV4jidAOjbUORU Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: f91efa94deff4ceb80b0a1aa88087421 Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:54:56.527188 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:54:56.529014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:54:56.529014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:54:56.529014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: f91efa94deff4ceb80b0a1aa88087421 Sep 06 04:54:56.529014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:54:56.529014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeTestJSON-1376563755-project Sep 06 04:54:56.529014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:54:56.529014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:54:56.529014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 31b919a031504f2bace596da457b91cf Sep 06 04:54:56.529014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeTestJSON-1376563755-project Sep 06 04:54:56.529014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:54:56.529014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. Sep 06 04:54:56.529014 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '4a742ba7-30f8-4f46-977e-a92938d6ea02'} Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:54:56.530228 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. Sep 06 04:54:56.532013 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:54:56.533546 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-d8b26090-ad6e-4c92-adbf-7d0f4a65deb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Returning 404 to user: Instance 4a742ba7-30f8-4f46-977e-a92938d6ea02 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:54:56.533546 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-d8b26090-ad6e-4c92-adbf-7d0f4a65deb7 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02" status: 404 len: 111 microversion: 2.1 time: 0.030560 Sep 06 04:54:56.533546 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 667/1350] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:54:56 2022] GET /compute/v2.1/servers/4a742ba7-30f8-4f46-977e-a92938d6ea02 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:54:57.801877 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-50e515cf-5498-4c7c-9786-6425419defa5 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:57.802369 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-50e515cf-5498-4c7c-9786-6425419defa5 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:57.810793 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50e515cf-5498-4c7c-9786-6425419defa5 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:57.811280 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50e515cf-5498-4c7c-9786-6425419defa5 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:57.811715 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50e515cf-5498-4c7c-9786-6425419defa5 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:57.812433 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50e515cf-5498-4c7c-9786-6425419defa5 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:57.812890 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50e515cf-5498-4c7c-9786-6425419defa5 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:57.813335 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-50e515cf-5498-4c7c-9786-6425419defa5 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:57.826982 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-50e515cf-5498-4c7c-9786-6425419defa5 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] HTTP exception thrown: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-50e515cf-5498-4c7c-9786-6425419defa5 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Request method failure captured: Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 HTTP/1.1 Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFtEa2RBYoPpw4bA3Ri0CxPZTQv5LG8ZoPb13IV3KJ6KLHQQpUoBvxRTZJCZThdHULwdjirVwlyQa7QQhPioROjFHkWCl1HaAiVxA9HU-pT7jwUisehEZgoSuodsCYUx-a1gWdAU1qpflC9UemjYRl6MpmpXUUTGxEvV4jidAOjbUORU Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: f91efa94deff4ceb80b0a1aa88087421 Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:54:57.828550 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:54:57.830366 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:54:57.830366 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:54:57.830366 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: f91efa94deff4ceb80b0a1aa88087421 Sep 06 04:54:57.830366 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:54:57.830366 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-AttachVolumeTestJSON-1376563755-project Sep 06 04:54:57.830366 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:54:57.830366 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:54:57.830366 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 31b919a031504f2bace596da457b91cf Sep 06 04:54:57.830366 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-AttachVolumeTestJSON-1376563755-project Sep 06 04:54:57.830366 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:54:57.830366 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. Sep 06 04:54:57.830366 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': '1b1fe518-288a-42d5-a385-829581568441'} Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:54:57.831683 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. Sep 06 04:54:57.833441 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:54:57.835052 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-50e515cf-5498-4c7c-9786-6425419defa5 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Returning 404 to user: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:54:57.835052 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-50e515cf-5498-4c7c-9786-6425419defa5 tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 404 len: 111 microversion: 2.1 time: 0.033916 Sep 06 04:54:57.835052 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 684/1351] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:54:57 2022] DELETE /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:54:57.838952 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2f8764c7-ec72-49d1-8d53-57b84e75d67c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:54:57.839569 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-2f8764c7-ec72-49d1-8d53-57b84e75d67c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] [instance: 1b1fe518-288a-42d5-a385-829581568441] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:54:57.845980 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f8764c7-ec72-49d1-8d53-57b84e75d67c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:57.846459 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f8764c7-ec72-49d1-8d53-57b84e75d67c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:57.846892 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f8764c7-ec72-49d1-8d53-57b84e75d67c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:57.847572 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f8764c7-ec72-49d1-8d53-57b84e75d67c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:54:57.848024 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f8764c7-ec72-49d1-8d53-57b84e75d67c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:54:57.848440 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-2f8764c7-ec72-49d1-8d53-57b84e75d67c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:54:57.862489 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-2f8764c7-ec72-49d1-8d53-57b84e75d67c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] HTTP exception thrown: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2f8764c7-ec72-49d1-8d53-57b84e75d67c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Request method failure captured: Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 HTTP/1.1 Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFtEa2RBYoPpw4bA3Ri0CxPZTQv5LG8ZoPb13IV3KJ6KLHQQpUoBvxRTZJCZThdHULwdjirVwlyQa7QQhPioROjFHkWCl1HaAiVxA9HU-pT7jwUisehEZgoSuodsCYUx-a1gWdAU1qpflC9UemjYRl6MpmpXUUTGxEvV4jidAOjbUORU Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: f91efa94deff4ceb80b0a1aa88087421 Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:54:57.864003 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:54:57.865784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f91efa94deff4ceb80b0a1aa88087421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:54:57.865784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:54:57.865784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: f91efa94deff4ceb80b0a1aa88087421 Sep 06 04:54:57.865784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1376563755 Sep 06 04:54:57.865784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-AttachVolumeTestJSON-1376563755-project Sep 06 04:54:57.865784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:54:57.865784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:54:57.865784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 31b919a031504f2bace596da457b91cf Sep 06 04:54:57.865784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-AttachVolumeTestJSON-1376563755-project Sep 06 04:54:57.865784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: > Sep 06 04:54:57.865784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. Sep 06 04:54:57.865784 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': '1b1fe518-288a-42d5-a385-829581568441'} Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:54:57.866915 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. Sep 06 04:54:57.869285 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:54:57.871000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-2f8764c7-ec72-49d1-8d53-57b84e75d67c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] Returning 404 to user: Instance 1b1fe518-288a-42d5-a385-829581568441 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:54:57.871000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-2f8764c7-ec72-49d1-8d53-57b84e75d67c tempest-AttachVolumeTestJSON-1376563755 tempest-AttachVolumeTestJSON-1376563755-project] 10.222.0.30 "GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441" status: 404 len: 111 microversion: 2.1 time: 0.030790 Sep 06 04:54:57.871000 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 668/1352] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:54:57 2022] GET /compute/v2.1/servers/1b1fe518-288a-42d5-a385-829581568441 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:55:03.479820 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1d33378d-327f-43f5-b3b6-8398d674005c tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Action: 'create', calling method: .version_select at 0x7f3176455dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1315216141", "metadata": {"Type": "work"}}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1d33378d-327f-43f5-b3b6-8398d674005c tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Request method failure captured: Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 122 Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFtKnG91AuMOc3QwE9Sm1VmcAPnr__3LZSevI0At4cLAWHwn7O8nQIcGU1qQzrRhOubk2UFO2-p--q4aK1ECN9cvjDdtJYyWAdwabLSavvWAfA5-v0SHuCQI5LThifQ4Q5askykNL_LC37bmwKlZfRy7-dDnS40JlQ-qDCWBxqR90j8I Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: c53397010e774adb8adb866bc2c886e7 Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:55:03.497926 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:55:03.499776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c53397010e774adb8adb866bc2c886e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:55:03.499776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.499776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: c53397010e774adb8adb866bc2c886e7 Sep 06 04:55:03.499776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.499776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesNegativeTest-1708057449-project Sep 06 04:55:03.499776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:55:03.499776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:55:03.499776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 07bac56b8ebf436189819d6cb0f0d8dc Sep 06 04:55:03.499776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesNegativeTest-1708057449-project Sep 06 04:55:03.499776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Sep 06 04:55:03.499776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1315216141", "metadata": {"Type": "work"}}} Sep 06 04:55:03.499776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: Sep 06 04:55:03.499776 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1315216141', 'metadata': {'Type': 'work'}}}} Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise error Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi '#$%' Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:55:03.500934 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 04:55:03.502860 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 04:55:03.504459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 06 04:55:03.504459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.504459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1d33378d-327f-43f5-b3b6-8398d674005c tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:55:03.504459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1d33378d-327f-43f5-b3b6-8398d674005c tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.134800 Sep 06 04:55:03.504459 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 685/1353] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Sep 6 04:55:03 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 04:55:03.509051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f54c8b82-3cbb-4526-b831-c9ec8c6d93a5 tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Action: 'create', calling method: .version_select at 0x7f31766638b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-60577240", "metadata": {"Type": "work"}}} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f54c8b82-3cbb-4526-b831-c9ec8c6d93a5 tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Request method failure captured: Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 118 Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFtKnG91AuMOc3QwE9Sm1VmcAPnr__3LZSevI0At4cLAWHwn7O8nQIcGU1qQzrRhOubk2UFO2-p--q4aK1ECN9cvjDdtJYyWAdwabLSavvWAfA5-v0SHuCQI5LThifQ4Q5askykNL_LC37bmwKlZfRy7-dDnS40JlQ-qDCWBxqR90j8I Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: c53397010e774adb8adb866bc2c886e7 Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:55:03.513916 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:55:03.515739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c53397010e774adb8adb866bc2c886e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:55:03.515739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.515739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: c53397010e774adb8adb866bc2c886e7 Sep 06 04:55:03.515739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.515739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesNegativeTest-1708057449-project Sep 06 04:55:03.515739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:55:03.515739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:55:03.515739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 07bac56b8ebf436189819d6cb0f0d8dc Sep 06 04:55:03.515739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesNegativeTest-1708057449-project Sep 06 04:55:03.515739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Sep 06 04:55:03.515739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-60577240", "metadata": {"Type": "work"}}} Sep 06 04:55:03.515739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: Sep 06 04:55:03.515739 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-60577240', 'metadata': {'Type': 'work'}}}} Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise error Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi '0' Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:55:03.516850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 04:55:03.518800 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 04:55:03.520433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 06 04:55:03.520433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.520433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-f54c8b82-3cbb-4526-b831-c9ec8c6d93a5 tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:55:03.520433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-f54c8b82-3cbb-4526-b831-c9ec8c6d93a5 tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010167 Sep 06 04:55:03.520433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 669/1354] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Sep 6 04:55:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 04:55:03.524267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-efa5919a-acd7-4ecd-85bb-e25174361fca tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Action: 'create', calling method: .version_select at 0x7f317643e5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1131008774", "metadata": {"Type": "work"}}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-efa5919a-acd7-4ecd-85bb-e25174361fca tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Request method failure captured: Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 119 Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFtKnG91AuMOc3QwE9Sm1VmcAPnr__3LZSevI0At4cLAWHwn7O8nQIcGU1qQzrRhOubk2UFO2-p--q4aK1ECN9cvjDdtJYyWAdwabLSavvWAfA5-v0SHuCQI5LThifQ4Q5askykNL_LC37bmwKlZfRy7-dDnS40JlQ-qDCWBxqR90j8I Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: c53397010e774adb8adb866bc2c886e7 Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:55:03.529646 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:55:03.531383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c53397010e774adb8adb866bc2c886e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:55:03.531383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.531383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: c53397010e774adb8adb866bc2c886e7 Sep 06 04:55:03.531383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.531383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesNegativeTest-1708057449-project Sep 06 04:55:03.531383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:55:03.531383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:55:03.531383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 07bac56b8ebf436189819d6cb0f0d8dc Sep 06 04:55:03.531383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesNegativeTest-1708057449-project Sep 06 04:55:03.531383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Sep 06 04:55:03.531383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1131008774", "metadata": {"Type": "work"}}} Sep 06 04:55:03.531383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: Sep 06 04:55:03.531383 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1131008774', 'metadata': {'Type': 'work'}}}} Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise error Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi '' Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:55:03.532461 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 06 04:55:03.534640 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 06 04:55:03.536177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 06 04:55:03.536177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.536177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-efa5919a-acd7-4ecd-85bb-e25174361fca tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:55:03.536177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-efa5919a-acd7-4ecd-85bb-e25174361fca tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010418 Sep 06 04:55:03.536177 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 686/1355] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Sep 6 04:55:03 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 06 04:55:03.541453 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c9412701-d655-4169-9384-736457e1731c tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Calling method '.version_select at 0x7f3179cbd9d0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:55:03.569917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-c9412701-d655-4169-9384-736457e1731c tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] HTTP exception thrown: Volume tempest-invalid-934689650 could not be found. Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c9412701-d655-4169-9384-736457e1731c tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Request method failure captured: Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-934689650 HTTP/1.1 Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFtKnG91AuMOc3QwE9Sm1VmcAPnr__3LZSevI0At4cLAWHwn7O8nQIcGU1qQzrRhOubk2UFO2-p--q4aK1ECN9cvjDdtJYyWAdwabLSavvWAfA5-v0SHuCQI5LThifQ4Q5askykNL_LC37bmwKlZfRy7-dDnS40JlQ-qDCWBxqR90j8I Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: c53397010e774adb8adb866bc2c886e7 Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:55:03.572148 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:55:03.573949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c53397010e774adb8adb866bc2c886e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:55:03.573949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.573949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: c53397010e774adb8adb866bc2c886e7 Sep 06 04:55:03.573949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.573949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesNegativeTest-1708057449-project Sep 06 04:55:03.573949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:55:03.573949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:55:03.573949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 07bac56b8ebf436189819d6cb0f0d8dc Sep 06 04:55:03.573949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesNegativeTest-1708057449-project Sep 06 04:55:03.573949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: Sep 06 04:55:03.573949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Volume tempest-invalid-934689650 could not be found. Sep 06 04:55:03.573949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': 'tempest-invalid-934689650'} Sep 06 04:55:03.573949 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-934689650 could not be found. (HTTP 404) (Request-ID: req-83e3d642-5214-4bc3-a7f9-c9031a4c45ac) Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:55:03.575051 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 04:55:03.576709 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-934689650 could not be found. Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:55:03.578537 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-934689650 could not be found. Sep 06 04:55:03.580218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.580218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:55:03.580218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.580218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.580218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:55:03.580218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:55:03.580218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:55:03.580218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:55:03.580218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-934689650 could not be found. Sep 06 04:55:03.580218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.580218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c9412701-d655-4169-9384-736457e1731c tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Returning 404 to user: Volume tempest-invalid-934689650 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:55:03.580218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c9412701-d655-4169-9384-736457e1731c tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-934689650" status: 404 len: 98 microversion: 2.1 time: 0.037063 Sep 06 04:55:03.580218 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 670/1356] 10.222.0.30 () {58 vars in 1215 bytes} [Tue Sep 6 04:55:03 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-934689650 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 06 04:55:03.583045 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-9a990dd0-ba59-4b48-988d-ca875680965a tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003752 Sep 06 04:55:03.583540 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 687/1357] 10.222.0.30 () {58 vars in 1140 bytes} [Tue Sep 6 04:55:03 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 04:55:03.592179 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-e39c7670-6ac0-4d84-bf09-1e763fcdb9f2 tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003623 Sep 06 04:55:03.592669 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 671/1358] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Sep 6 04:55:03 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 06 04:55:03.600474 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d0aa9504-be8b-42e3-b641-2ac004eb3fbb tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Calling method '.version_select at 0x7f31768499d0>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:55:03.628578 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-d0aa9504-be8b-42e3-b641-2ac004eb3fbb tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] HTTP exception thrown: Volume ed3014ae-1666-4b60-973b-9d82ba93cf5f could not be found. Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d0aa9504-be8b-42e3-b641-2ac004eb3fbb tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Request method failure captured: Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: DELETE /compute/v2.1/os-volumes/ed3014ae-1666-4b60-973b-9d82ba93cf5f HTTP/1.1 Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFtKnG91AuMOc3QwE9Sm1VmcAPnr__3LZSevI0At4cLAWHwn7O8nQIcGU1qQzrRhOubk2UFO2-p--q4aK1ECN9cvjDdtJYyWAdwabLSavvWAfA5-v0SHuCQI5LThifQ4Q5askykNL_LC37bmwKlZfRy7-dDnS40JlQ-qDCWBxqR90j8I Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: c53397010e774adb8adb866bc2c886e7 Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:55:03.630538 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:55:03.632281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c53397010e774adb8adb866bc2c886e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:55:03.632281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.632281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: c53397010e774adb8adb866bc2c886e7 Sep 06 04:55:03.632281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.632281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesNegativeTest-1708057449-project Sep 06 04:55:03.632281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:55:03.632281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:55:03.632281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 07bac56b8ebf436189819d6cb0f0d8dc Sep 06 04:55:03.632281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesNegativeTest-1708057449-project Sep 06 04:55:03.632281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: Sep 06 04:55:03.632281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Volume ed3014ae-1666-4b60-973b-9d82ba93cf5f could not be found. Sep 06 04:55:03.632281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': 'ed3014ae-1666-4b60-973b-9d82ba93cf5f'} Sep 06 04:55:03.632281 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed3014ae-1666-4b60-973b-9d82ba93cf5f could not be found. (HTTP 404) (Request-ID: req-1110dc67-48bc-48ca-b55d-442d159708ec) Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:55:03.633413 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 06 04:55:03.635874 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed3014ae-1666-4b60-973b-9d82ba93cf5f could not be found. Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 06 04:55:03.637590 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:55:03.639111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed3014ae-1666-4b60-973b-9d82ba93cf5f could not be found. Sep 06 04:55:03.639111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.639111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:55:03.639111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.639111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.639111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:55:03.639111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:55:03.639111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:55:03.639111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:55:03.639111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed3014ae-1666-4b60-973b-9d82ba93cf5f could not be found. Sep 06 04:55:03.639111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.639111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d0aa9504-be8b-42e3-b641-2ac004eb3fbb tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Returning 404 to user: Volume ed3014ae-1666-4b60-973b-9d82ba93cf5f could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:55:03.639111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d0aa9504-be8b-42e3-b641-2ac004eb3fbb tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/ed3014ae-1666-4b60-973b-9d82ba93cf5f" status: 404 len: 109 microversion: 2.1 time: 0.034929 Sep 06 04:55:03.639111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 688/1359] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Sep 6 04:55:03 2022] DELETE /compute/v2.1/os-volumes/ed3014ae-1666-4b60-973b-9d82ba93cf5f => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:55:03.641924 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-961ee1ab-dd69-43f3-8713-c7e6ba03505f tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Calling method '.version_select at 0x7f31766638b0>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:55:03.668611 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.wsgi [None req-961ee1ab-dd69-43f3-8713-c7e6ba03505f tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] HTTP exception thrown: Volume ce7b46fb-24b8-461c-9c4f-cd49d100dab7 could not be found. Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-961ee1ab-dd69-43f3-8713-c7e6ba03505f tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Request method failure captured: Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: request: GET /compute/v2.1/os-volumes/ce7b46fb-24b8-461c-9c4f-cd49d100dab7 HTTP/1.1 Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept: application/json Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Accept-Encoding: identity Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Connection: close Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Length: 0 Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Content-Type: application/json Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Host: 10.222.0.30 Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: Openstack-System-Scope: None Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: User-Agent: python-urllib3/1.26.12 Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Auth-Token: gAAAAABjFtKnG91AuMOc3QwE9Sm1VmcAPnr__3LZSevI0At4cLAWHwn7O8nQIcGU1qQzrRhOubk2UFO2-p--q4aK1ECN9cvjDdtJYyWAdwabLSavvWAfA5-v0SHuCQI5LThifQ4Q5askykNL_LC37bmwKlZfRy7-dDnS40JlQ-qDCWBxqR90j8I Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Id: None Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Domain-Name: None Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Identity-Status: Confirmed Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Is-Admin-Project: True Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Id: default Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Domain-Name: Default Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Id: c53397010e774adb8adb866bc2c886e7 Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Project-Name: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Role: member,reader Sep 06 04:55:03.670663 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Roles: member,reader Sep 06 04:55:03.672419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c53397010e774adb8adb866bc2c886e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c53397010e774adb8adb866bc2c886e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:55:03.672419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.672419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Id: c53397010e774adb8adb866bc2c886e7 Sep 06 04:55:03.672419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-Tenant-Name: tempest-VolumesNegativeTest-1708057449 Sep 06 04:55:03.672419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User: tempest-VolumesNegativeTest-1708057449-project Sep 06 04:55:03.672419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Id: default Sep 06 04:55:03.672419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Domain-Name: Default Sep 06 04:55:03.672419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Id: 07bac56b8ebf436189819d6cb0f0d8dc Sep 06 04:55:03.672419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: X-User-Name: tempest-VolumesNegativeTest-1708057449-project Sep 06 04:55:03.672419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: method: Sep 06 04:55:03.672419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: exception: Volume ce7b46fb-24b8-461c-9c4f-cd49d100dab7 could not be found. Sep 06 04:55:03.672419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: action_args: {'id': 'ce7b46fb-24b8-461c-9c4f-cd49d100dab7'} Sep 06 04:55:03.672419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce7b46fb-24b8-461c-9c4f-cd49d100dab7 could not be found. (HTTP 404) (Request-ID: req-ae4298f4-b3fd-434f-b1ad-dea1c5da28e4) Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:55:03.673435 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 06 04:55:03.674825 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce7b46fb-24b8-461c-9c4f-cd49d100dab7 could not be found. Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 06 04:55:03.676118 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:55:03.677478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce7b46fb-24b8-461c-9c4f-cd49d100dab7 could not be found. Sep 06 04:55:03.677478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.677478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:55:03.677478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.677478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:55:03.677478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:55:03.677478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:55:03.677478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:55:03.677478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:55:03.677478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce7b46fb-24b8-461c-9c4f-cd49d100dab7 could not be found. Sep 06 04:55:03.677478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR nova.api.openstack.wsgi Sep 06 04:55:03.677478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-961ee1ab-dd69-43f3-8713-c7e6ba03505f tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] Returning 404 to user: Volume ce7b46fb-24b8-461c-9c4f-cd49d100dab7 could not be found. {{(pid=127617) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:55:03.677478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-961ee1ab-dd69-43f3-8713-c7e6ba03505f tempest-VolumesNegativeTest-1708057449 tempest-VolumesNegativeTest-1708057449-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/ce7b46fb-24b8-461c-9c4f-cd49d100dab7" status: 404 len: 109 microversion: 2.1 time: 0.033909 Sep 06 04:55:03.677478 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 672/1360] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Sep 6 04:55:03 2022] GET /compute/v2.1/os-volumes/ce7b46fb-24b8-461c-9c4f-cd49d100dab7 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 06 04:56:29.602011 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:56:29.602801 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:56:29.606230 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 04:56:29.606394 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Tue Sep 6 04:56:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Sep 06 04:56:29.607352 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 06 04:56:29.607471 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Tue Sep 6 04:56:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.30) !!! Sep 06 04:56:29.613278 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1495627581", "imageRef": "95f7fb55-963c-4f1f-9868-6609dc7a03bc", "flavorRef": "452"}} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:56:29.821788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.network.neutron [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] validate_networks() for None {{(pid=127618) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 06 04:56:30.086709 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Flavor limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 06 04:56:30.087157 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Image limits 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 06 04:56:30.087620 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Flavor pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 06 04:56:30.088065 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Image pref 0:0:0 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 06 04:56:30.088481 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.virt.hardware [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127618) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 06 04:56:30.107883 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:30.108371 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:30.109502 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:30.110239 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:30.110698 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:30.111128 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:30.135213 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Getting quotas for project 91d43687f40743dab7741801f3acc47d. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 06 04:56:30.141058 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.quota [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Getting quotas for user 4b6a7dffa116413bb0e61e05d9494273 and project 91d43687f40743dab7741801f3acc47d. Resources: {'cores', 'instances', 'ram'} {{(pid=127618) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 06 04:56:30.155143 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Going to run 1 instances... {{(pid=127618) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 06 04:56:30.158807 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='95f7fb55-963c-4f1f-9868-6609dc7a03bc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127618) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 06 04:56:30.289566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ada4358e-dfc2-44b5-ad88-f750b4623943 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689202 Sep 06 04:56:30.290159 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 689/1361] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Sep 6 04:56:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 06 04:56:30.302077 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c43f499a-e07d-4203-8475-f6f4c757ac93] AMQP server on 10.222.0.30:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 06 04:56:30.302633 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:56:30.303377 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:56:30.309902 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-a593314a-bb55-4428-82f0-c26aded6fafd tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:30.311381 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-a593314a-bb55-4428-82f0-c26aded6fafd tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:30.472323 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-a593314a-bb55-4428-82f0-c26aded6fafd tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:30.480023 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-a593314a-bb55-4428-82f0-c26aded6fafd tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1215 microversion: 2.1 time: 0.181462 Sep 06 04:56:30.480190 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 673/1362] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:30 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 06 04:56:31.503959 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-1125fc0a-761a-489a-8134-73c62f1a84cd tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:31.504506 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-1125fc0a-761a-489a-8134-73c62f1a84cd tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:31.510612 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1125fc0a-761a-489a-8134-73c62f1a84cd tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:31.511088 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1125fc0a-761a-489a-8134-73c62f1a84cd tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:31.511526 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1125fc0a-761a-489a-8134-73c62f1a84cd tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:31.512205 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1125fc0a-761a-489a-8134-73c62f1a84cd tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:31.512660 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1125fc0a-761a-489a-8134-73c62f1a84cd tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:31.513079 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-1125fc0a-761a-489a-8134-73c62f1a84cd tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:31.578615 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-1125fc0a-761a-489a-8134-73c62f1a84cd tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:31.586415 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-1125fc0a-761a-489a-8134-73c62f1a84cd tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1219 microversion: 2.1 time: 0.086920 Sep 06 04:56:31.586986 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 690/1363] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:31 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:32.608042 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-4e78120a-2727-4eae-a1e2-5b3cad4f52b6 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:32.608650 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-4e78120a-2727-4eae-a1e2-5b3cad4f52b6 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:32.617199 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e78120a-2727-4eae-a1e2-5b3cad4f52b6 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:32.617710 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e78120a-2727-4eae-a1e2-5b3cad4f52b6 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:32.618151 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e78120a-2727-4eae-a1e2-5b3cad4f52b6 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:32.618845 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e78120a-2727-4eae-a1e2-5b3cad4f52b6 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:32.619293 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e78120a-2727-4eae-a1e2-5b3cad4f52b6 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:32.619721 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-4e78120a-2727-4eae-a1e2-5b3cad4f52b6 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:32.641839 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO oslo.messaging._drivers.impl_rabbit [-] [c43f499a-e07d-4203-8475-f6f4c757ac93] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 57058. Sep 06 04:56:32.696999 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-4e78120a-2727-4eae-a1e2-5b3cad4f52b6 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:32.707216 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-4e78120a-2727-4eae-a1e2-5b3cad4f52b6 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1275 microversion: 2.1 time: 0.102978 Sep 06 04:56:32.708157 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 674/1364] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:32 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1275 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:33.736929 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-a5dae834-48c1-4c79-92ce-9de529a8a637 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:33.737771 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-a5dae834-48c1-4c79-92ce-9de529a8a637 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:33.744064 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5dae834-48c1-4c79-92ce-9de529a8a637 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:33.744553 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5dae834-48c1-4c79-92ce-9de529a8a637 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:33.744993 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5dae834-48c1-4c79-92ce-9de529a8a637 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:33.745717 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5dae834-48c1-4c79-92ce-9de529a8a637 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:33.746172 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5dae834-48c1-4c79-92ce-9de529a8a637 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:33.746603 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-a5dae834-48c1-4c79-92ce-9de529a8a637 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:33.878816 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-a5dae834-48c1-4c79-92ce-9de529a8a637 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:33.886566 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-a5dae834-48c1-4c79-92ce-9de529a8a637 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1315 microversion: 2.1 time: 0.154445 Sep 06 04:56:33.887167 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 691/1365] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:33 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:34.422391 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-ab72c4c2-263a-4435-b885-52a820502f6c req-09602c7a-651f-4d42-b83c-130813b2355d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e21191-04d9-45d3-9a4e-a7fc147a06e8", "tag": "b6b16d0a-76ca-437d-bc9b-9d85eea4c913"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:56:34.432644 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-ab72c4c2-263a-4435-b885-52a820502f6c req-09602c7a-651f-4d42-b83c-130813b2355d service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:34.433097 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-ab72c4c2-263a-4435-b885-52a820502f6c req-09602c7a-651f-4d42-b83c-130813b2355d service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:34.433544 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-ab72c4c2-263a-4435-b885-52a820502f6c req-09602c7a-651f-4d42-b83c-130813b2355d service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:34.445162 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-ab72c4c2-263a-4435-b885-52a820502f6c req-09602c7a-651f-4d42-b83c-130813b2355d service nova] Creating event network-changed:b6b16d0a-76ca-437d-bc9b-9d85eea4c913 for instance f5e21191-04d9-45d3-9a4e-a7fc147a06e8 on hv-cinder-85600 Sep 06 04:56:34.450840 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-ab72c4c2-263a-4435-b885-52a820502f6c req-09602c7a-651f-4d42-b83c-130813b2355d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033718 Sep 06 04:56:34.451534 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 675/1366] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 06 04:56:34.911231 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-d12dd2fa-1a2c-46db-98bb-b862c076c28e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:34.911854 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-d12dd2fa-1a2c-46db-98bb-b862c076c28e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:34.918610 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d12dd2fa-1a2c-46db-98bb-b862c076c28e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:34.919100 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d12dd2fa-1a2c-46db-98bb-b862c076c28e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:34.919542 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d12dd2fa-1a2c-46db-98bb-b862c076c28e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:34.920244 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d12dd2fa-1a2c-46db-98bb-b862c076c28e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:34.920708 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d12dd2fa-1a2c-46db-98bb-b862c076c28e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:34.921133 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-d12dd2fa-1a2c-46db-98bb-b862c076c28e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:35.051267 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-d12dd2fa-1a2c-46db-98bb-b862c076c28e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:35.059277 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-d12dd2fa-1a2c-46db-98bb-b862c076c28e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1315 microversion: 2.1 time: 0.152344 Sep 06 04:56:35.061954 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 692/1367] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:34 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:36.083016 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-783cb89b-60d2-48d4-9433-153b930b4573 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:36.083713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-783cb89b-60d2-48d4-9433-153b930b4573 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:36.090354 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-783cb89b-60d2-48d4-9433-153b930b4573 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:36.090831 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-783cb89b-60d2-48d4-9433-153b930b4573 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:36.091348 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-783cb89b-60d2-48d4-9433-153b930b4573 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:36.092029 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-783cb89b-60d2-48d4-9433-153b930b4573 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:36.092487 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-783cb89b-60d2-48d4-9433-153b930b4573 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:36.092905 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-783cb89b-60d2-48d4-9433-153b930b4573 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:36.227054 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-783cb89b-60d2-48d4-9433-153b930b4573 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:36.234836 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-783cb89b-60d2-48d4-9433-153b930b4573 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1315 microversion: 2.1 time: 0.156022 Sep 06 04:56:36.235397 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 676/1368] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:36 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:37.257680 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-5a769d09-ffa4-4cc5-aac8-456440b3184a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:37.258332 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-5a769d09-ffa4-4cc5-aac8-456440b3184a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:37.264583 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a769d09-ffa4-4cc5-aac8-456440b3184a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:37.265109 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a769d09-ffa4-4cc5-aac8-456440b3184a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:37.265684 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a769d09-ffa4-4cc5-aac8-456440b3184a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:37.266382 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a769d09-ffa4-4cc5-aac8-456440b3184a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:37.266833 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a769d09-ffa4-4cc5-aac8-456440b3184a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:37.267250 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-5a769d09-ffa4-4cc5-aac8-456440b3184a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:37.400326 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-5a769d09-ffa4-4cc5-aac8-456440b3184a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:37.408788 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-5a769d09-ffa4-4cc5-aac8-456440b3184a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1315 microversion: 2.1 time: 0.154928 Sep 06 04:56:37.409373 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 693/1369] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:37 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:38.432811 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-7d186aed-c0e7-4c5a-81e6-01c6ff3f7375 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:38.433442 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-7d186aed-c0e7-4c5a-81e6-01c6ff3f7375 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:38.440899 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7d186aed-c0e7-4c5a-81e6-01c6ff3f7375 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:38.441421 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7d186aed-c0e7-4c5a-81e6-01c6ff3f7375 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:38.441858 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7d186aed-c0e7-4c5a-81e6-01c6ff3f7375 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:38.442547 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7d186aed-c0e7-4c5a-81e6-01c6ff3f7375 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:38.442998 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7d186aed-c0e7-4c5a-81e6-01c6ff3f7375 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:38.443420 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-7d186aed-c0e7-4c5a-81e6-01c6ff3f7375 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:38.571646 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-7d186aed-c0e7-4c5a-81e6-01c6ff3f7375 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:38.579843 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-7d186aed-c0e7-4c5a-81e6-01c6ff3f7375 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1315 microversion: 2.1 time: 0.150856 Sep 06 04:56:38.580409 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 677/1370] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:38 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:39.603872 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-30787698-f251-480d-ada2-9241ce539a77 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:39.604481 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-30787698-f251-480d-ada2-9241ce539a77 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:39.611477 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30787698-f251-480d-ada2-9241ce539a77 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:39.611957 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30787698-f251-480d-ada2-9241ce539a77 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:39.612392 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30787698-f251-480d-ada2-9241ce539a77 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:39.613071 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30787698-f251-480d-ada2-9241ce539a77 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:39.613544 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30787698-f251-480d-ada2-9241ce539a77 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:39.613968 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-30787698-f251-480d-ada2-9241ce539a77 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:39.737887 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-30787698-f251-480d-ada2-9241ce539a77 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:39.745668 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-30787698-f251-480d-ada2-9241ce539a77 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1315 microversion: 2.1 time: 0.145621 Sep 06 04:56:39.746242 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 694/1371] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:39 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:40.768884 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-924f7afc-522d-428a-9c6c-88e3d9fa6585 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:40.769525 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-924f7afc-522d-428a-9c6c-88e3d9fa6585 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:40.771961 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG dbcounter [-] [127617] Writing DB stats nova_cell0:SELECT=2 {{(pid=127617) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:56:40.776697 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-924f7afc-522d-428a-9c6c-88e3d9fa6585 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:40.777180 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-924f7afc-522d-428a-9c6c-88e3d9fa6585 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:40.777646 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-924f7afc-522d-428a-9c6c-88e3d9fa6585 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:40.783074 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-924f7afc-522d-428a-9c6c-88e3d9fa6585 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:40.783074 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-924f7afc-522d-428a-9c6c-88e3d9fa6585 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:40.783074 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-924f7afc-522d-428a-9c6c-88e3d9fa6585 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:40.906045 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-924f7afc-522d-428a-9c6c-88e3d9fa6585 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:40.914834 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-924f7afc-522d-428a-9c6c-88e3d9fa6585 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1315 microversion: 2.1 time: 0.149889 Sep 06 04:56:40.914834 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 678/1372] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:40 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:41.936159 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-c1137224-f51b-4874-b524-28ba11ac1c1e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:41.936811 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-c1137224-f51b-4874-b524-28ba11ac1c1e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:41.938719 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=2 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:56:41.939399 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG dbcounter [-] [127618] Writing DB stats nova_cell0:SELECT=6 {{(pid=127618) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 04:56:41.944542 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1137224-f51b-4874-b524-28ba11ac1c1e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:41.945013 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1137224-f51b-4874-b524-28ba11ac1c1e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:41.945480 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1137224-f51b-4874-b524-28ba11ac1c1e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:41.946159 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1137224-f51b-4874-b524-28ba11ac1c1e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:41.946607 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1137224-f51b-4874-b524-28ba11ac1c1e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:41.947026 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-c1137224-f51b-4874-b524-28ba11ac1c1e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:42.326826 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-c1137224-f51b-4874-b524-28ba11ac1c1e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:42.335509 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-c1137224-f51b-4874-b524-28ba11ac1c1e tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1315 microversion: 2.1 time: 0.403178 Sep 06 04:56:42.336085 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 695/1373] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:41 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:42.708249 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [req-928d9ad3-e136-40f4-bb2f-9de73e9bcc08 req-dd87472a-9ae8-4400-a423-bb61fb44bfb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e21191-04d9-45d3-9a4e-a7fc147a06e8", "name": "network-vif-plugged", "status": "completed", "tag": "b6b16d0a-76ca-437d-bc9b-9d85eea4c913"}]} {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:56:42.717649 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-928d9ad3-e136-40f4-bb2f-9de73e9bcc08 req-dd87472a-9ae8-4400-a423-bb61fb44bfb1 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:42.718146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-928d9ad3-e136-40f4-bb2f-9de73e9bcc08 req-dd87472a-9ae8-4400-a423-bb61fb44bfb1 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:42.718568 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [req-928d9ad3-e136-40f4-bb2f-9de73e9bcc08 req-dd87472a-9ae8-4400-a423-bb61fb44bfb1 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:42.729229 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.compute.server_external_events [req-928d9ad3-e136-40f4-bb2f-9de73e9bcc08 req-dd87472a-9ae8-4400-a423-bb61fb44bfb1 service nova] Creating event network-vif-plugged:b6b16d0a-76ca-437d-bc9b-9d85eea4c913 for instance f5e21191-04d9-45d3-9a4e-a7fc147a06e8 on hv-cinder-85600 Sep 06 04:56:42.734811 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [req-928d9ad3-e136-40f4-bb2f-9de73e9bcc08 req-dd87472a-9ae8-4400-a423-bb61fb44bfb1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088920 Sep 06 04:56:42.735540 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 679/1374] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:56:43.358636 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-82f06375-c0c6-4603-b99a-4c1ac48cc437 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:43.359279 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-82f06375-c0c6-4603-b99a-4c1ac48cc437 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:43.365823 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82f06375-c0c6-4603-b99a-4c1ac48cc437 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:43.366313 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82f06375-c0c6-4603-b99a-4c1ac48cc437 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:43.366756 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82f06375-c0c6-4603-b99a-4c1ac48cc437 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:43.367463 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82f06375-c0c6-4603-b99a-4c1ac48cc437 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:43.367907 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82f06375-c0c6-4603-b99a-4c1ac48cc437 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:43.368335 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-82f06375-c0c6-4603-b99a-4c1ac48cc437 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:43.500333 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-82f06375-c0c6-4603-b99a-4c1ac48cc437 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:43.507947 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-82f06375-c0c6-4603-b99a-4c1ac48cc437 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1315 microversion: 2.1 time: 0.153243 Sep 06 04:56:43.508520 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 696/1375] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:43 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:44.531791 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-c79a8bfe-d323-478d-b14b-4e860aabd39a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:44.532481 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-c79a8bfe-d323-478d-b14b-4e860aabd39a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:44.538917 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c79a8bfe-d323-478d-b14b-4e860aabd39a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:44.539419 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c79a8bfe-d323-478d-b14b-4e860aabd39a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:44.539850 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c79a8bfe-d323-478d-b14b-4e860aabd39a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:44.540526 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c79a8bfe-d323-478d-b14b-4e860aabd39a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:44.540971 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c79a8bfe-d323-478d-b14b-4e860aabd39a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:44.541415 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-c79a8bfe-d323-478d-b14b-4e860aabd39a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:44.674378 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-c79a8bfe-d323-478d-b14b-4e860aabd39a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:44.682047 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-c79a8bfe-d323-478d-b14b-4e860aabd39a tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1315 microversion: 2.1 time: 0.155637 Sep 06 04:56:44.682613 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 680/1376] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:44 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:45.705054 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-aab46d31-8cd5-47e7-9e62-4b4b63f97693 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:45.705668 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-aab46d31-8cd5-47e7-9e62-4b4b63f97693 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:45.712066 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aab46d31-8cd5-47e7-9e62-4b4b63f97693 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:45.712545 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aab46d31-8cd5-47e7-9e62-4b4b63f97693 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:45.713019 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aab46d31-8cd5-47e7-9e62-4b4b63f97693 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:45.713726 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aab46d31-8cd5-47e7-9e62-4b4b63f97693 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:45.714178 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aab46d31-8cd5-47e7-9e62-4b4b63f97693 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:45.714600 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-aab46d31-8cd5-47e7-9e62-4b4b63f97693 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:45.843818 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-aab46d31-8cd5-47e7-9e62-4b4b63f97693 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:45.851399 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-aab46d31-8cd5-47e7-9e62-4b4b63f97693 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1465 microversion: 2.1 time: 0.150942 Sep 06 04:56:45.851956 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 697/1377] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:45 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1465 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:45.906982 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-cff84a39-d99a-4c55-a47d-fc541ba83f32 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:45.912088 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cff84a39-d99a-4c55-a47d-fc541ba83f32 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:45.914095 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cff84a39-d99a-4c55-a47d-fc541ba83f32 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:45.914551 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cff84a39-d99a-4c55-a47d-fc541ba83f32 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:45.915001 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cff84a39-d99a-4c55-a47d-fc541ba83f32 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:45.915675 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cff84a39-d99a-4c55-a47d-fc541ba83f32 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:45.916120 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cff84a39-d99a-4c55-a47d-fc541ba83f32 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:45.916538 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-cff84a39-d99a-4c55-a47d-fc541ba83f32 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:45.941787 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-cff84a39-d99a-4c55-a47d-fc541ba83f32 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Going to try to terminate instance {{(pid=127617) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 06 04:56:46.190781 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-cff84a39-d99a-4c55-a47d-fc541ba83f32 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 204 len: 0 microversion: 2.1 time: 0.287810 Sep 06 04:56:46.191644 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 681/1378] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Sep 6 04:56:45 2022] DELETE /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 06 04:56:46.199909 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-ece37e2e-7816-42c3-ae1e-815ed8ba23f1 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:46.201493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-ece37e2e-7816-42c3-ae1e-815ed8ba23f1 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:46.207014 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ece37e2e-7816-42c3-ae1e-815ed8ba23f1 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:46.207479 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ece37e2e-7816-42c3-ae1e-815ed8ba23f1 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:46.207904 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ece37e2e-7816-42c3-ae1e-815ed8ba23f1 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:46.208579 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ece37e2e-7816-42c3-ae1e-815ed8ba23f1 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:46.209026 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ece37e2e-7816-42c3-ae1e-815ed8ba23f1 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:46.209480 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-ece37e2e-7816-42c3-ae1e-815ed8ba23f1 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:46.336695 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.policy [None req-ece37e2e-7816-42c3-ae1e-815ed8ba23f1 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127618) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:46.345111 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-ece37e2e-7816-42c3-ae1e-815ed8ba23f1 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1471 microversion: 2.1 time: 0.149027 Sep 06 04:56:46.345705 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 698/1379] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:46 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:47.368713 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-609a1431-f413-48aa-8496-7572fb83e466 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:47.369430 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-609a1431-f413-48aa-8496-7572fb83e466 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:47.375812 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-609a1431-f413-48aa-8496-7572fb83e466 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:47.376291 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-609a1431-f413-48aa-8496-7572fb83e466 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:47.376752 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-609a1431-f413-48aa-8496-7572fb83e466 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:47.377463 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-609a1431-f413-48aa-8496-7572fb83e466 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:47.377913 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-609a1431-f413-48aa-8496-7572fb83e466 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:47.378334 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-609a1431-f413-48aa-8496-7572fb83e466 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:47.513851 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-609a1431-f413-48aa-8496-7572fb83e466 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:47.522281 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-609a1431-f413-48aa-8496-7572fb83e466 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1471 microversion: 2.1 time: 0.157818 Sep 06 04:56:47.522970 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 682/1380] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:47 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:48.297716 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [req-b6f4ee31-6ab8-4b9a-97db-64a1bf2190f8 req-06d85d58-9a1c-4f8a-a7d7-dda1bae60957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e21191-04d9-45d3-9a4e-a7fc147a06e8", "name": "network-vif-deleted", "tag": "b6b16d0a-76ca-437d-bc9b-9d85eea4c913"}]} {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 06 04:56:48.308006 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b6f4ee31-6ab8-4b9a-97db-64a1bf2190f8 req-06d85d58-9a1c-4f8a-a7d7-dda1bae60957 service nova] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:48.308485 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b6f4ee31-6ab8-4b9a-97db-64a1bf2190f8 req-06d85d58-9a1c-4f8a-a7d7-dda1bae60957 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:48.308912 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [req-b6f4ee31-6ab8-4b9a-97db-64a1bf2190f8 req-06d85d58-9a1c-4f8a-a7d7-dda1bae60957 service nova] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:48.321939 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.compute.server_external_events [req-b6f4ee31-6ab8-4b9a-97db-64a1bf2190f8 req-06d85d58-9a1c-4f8a-a7d7-dda1bae60957 service nova] Creating event network-vif-deleted:b6b16d0a-76ca-437d-bc9b-9d85eea4c913 for instance f5e21191-04d9-45d3-9a4e-a7fc147a06e8 on hv-cinder-85600 Sep 06 04:56:48.327378 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [req-b6f4ee31-6ab8-4b9a-97db-64a1bf2190f8 req-06d85d58-9a1c-4f8a-a7d7-dda1bae60957 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033959 Sep 06 04:56:48.328083 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 699/1381] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Sep 6 04:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 06 04:56:48.546345 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.api.openstack.wsgi [None req-ddbd0a44-0a60-4ba9-a724-ae7e070f4295 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127617) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:48.547164 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.compute.api [None req-ddbd0a44-0a60-4ba9-a724-ae7e070f4295 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127617) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:48.553532 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddbd0a44-0a60-4ba9-a724-ae7e070f4295 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:48.554005 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddbd0a44-0a60-4ba9-a724-ae7e070f4295 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:48.554433 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddbd0a44-0a60-4ba9-a724-ae7e070f4295 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:48.555119 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddbd0a44-0a60-4ba9-a724-ae7e070f4295 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:48.555546 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddbd0a44-0a60-4ba9-a724-ae7e070f4295 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:48.555960 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddbd0a44-0a60-4ba9-a724-ae7e070f4295 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:48.587247 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddbd0a44-0a60-4ba9-a724-ae7e070f4295 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:48.587718 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddbd0a44-0a60-4ba9-a724-ae7e070f4295 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:48.588146 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG oslo_concurrency.lockutils [None req-ddbd0a44-0a60-4ba9-a724-ae7e070f4295 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127617) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:48.588580 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.objects.instance [None req-ddbd0a44-0a60-4ba9-a724-ae7e070f4295 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lazy-loading 'fault' on Instance uuid f5e21191-04d9-45d3-9a4e-a7fc147a06e8 {{(pid=127617) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 06 04:56:48.632472 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: DEBUG nova.policy [None req-ddbd0a44-0a60-4ba9-a724-ae7e070f4295 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b6a7dffa116413bb0e61e05d9494273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91d43687f40743dab7741801f3acc47d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127617) authorize /opt/stack/nova/nova/policy.py:199}} Sep 06 04:56:48.640368 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: INFO nova.api.openstack.requestlog [None req-ddbd0a44-0a60-4ba9-a724-ae7e070f4295 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 200 len: 1305 microversion: 2.1 time: 0.098291 Sep 06 04:56:48.641563 dv-cinder-856002-1-iscsi devstack@n-api.service[127617]: [pid: 127617|app: 0|req: 683/1382] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:48 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 06 04:56:49.665733 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-19083058-2a6e-4ae4-9f29-86a8946f0476 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Calling method '>' {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 06 04:56:49.666356 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.compute.api [None req-19083058-2a6e-4ae4-9f29-86a8946f0476 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] [instance: f5e21191-04d9-45d3-9a4e-a7fc147a06e8] Fetching instance by UUID {{(pid=127618) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 06 04:56:49.672481 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-19083058-2a6e-4ae4-9f29-86a8946f0476 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:49.672961 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-19083058-2a6e-4ae4-9f29-86a8946f0476 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:49.674207 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-19083058-2a6e-4ae4-9f29-86a8946f0476 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:49.674899 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-19083058-2a6e-4ae4-9f29-86a8946f0476 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Acquiring lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 06 04:56:49.675352 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-19083058-2a6e-4ae4-9f29-86a8946f0476 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 06 04:56:49.675775 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG oslo_concurrency.lockutils [None req-19083058-2a6e-4ae4-9f29-86a8946f0476 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Lock "b1fcff94-52a9-4308-8b15-a7ecd9f60a15" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127618) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 06 04:56:49.688620 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.wsgi [None req-19083058-2a6e-4ae4-9f29-86a8946f0476 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] HTTP exception thrown: Instance f5e21191-04d9-45d3-9a4e-a7fc147a06e8 could not be found. Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-19083058-2a6e-4ae4-9f29-86a8946f0476 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Request method failure captured: Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: request: GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 HTTP/1.1 Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept: application/json Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Accept-Encoding: identity Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Connection: close Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Length: 0 Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Content-Type: application/json Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Host: 10.222.0.30 Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: Openstack-System-Scope: None Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: User-Agent: python-urllib3/1.26.12 Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Auth-Token: gAAAAABjFtL7HcCFga5U3Ibl2LAIVLSPplqmJKrfEduxlyeSpLTCe0-qGFdsNEIKgrHXLsobh1BZsWqn8VDR3oVhtpjztZG7tzQfKfhy_UvqGK3nbaUOn3z2zEh8xA3fUj3UZhZ2aVZltFRwZk061A01B295KI3FMkbE9vrpgtddjaq3s1-0bY0 Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Id: None Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Domain-Name: None Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Identity-Status: Confirmed Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Is-Admin-Project: True Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Id: default Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Domain-Name: Default Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Id: 91d43687f40743dab7741801f3acc47d Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Project-Name: tempest-VolumesNegativeTest-2127341716 Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Role: member,reader Sep 06 04:56:49.690589 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Roles: member,reader Sep 06 04:56:49.692493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/91d43687f40743dab7741801f3acc47d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91d43687f40743dab7741801f3acc47d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_91d43687f40743dab7741801f3acc47d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/91d43687f40743dab7741801f3acc47d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}] Sep 06 04:56:49.692493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant: tempest-VolumesNegativeTest-2127341716 Sep 06 04:56:49.692493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Id: 91d43687f40743dab7741801f3acc47d Sep 06 04:56:49.692493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-Tenant-Name: tempest-VolumesNegativeTest-2127341716 Sep 06 04:56:49.692493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User: tempest-VolumesNegativeTest-2127341716-project Sep 06 04:56:49.692493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Id: default Sep 06 04:56:49.692493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Domain-Name: Default Sep 06 04:56:49.692493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Id: 4b6a7dffa116413bb0e61e05d9494273 Sep 06 04:56:49.692493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: X-User-Name: tempest-VolumesNegativeTest-2127341716-project Sep 06 04:56:49.692493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: method: > Sep 06 04:56:49.692493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: exception: Instance f5e21191-04d9-45d3-9a4e-a7fc147a06e8 could not be found. Sep 06 04:56:49.692493 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: action_args: {'id': 'f5e21191-04d9-45d3-9a4e-a7fc147a06e8'} Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: {{(pid=127618) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e21191-04d9-45d3-9a4e-a7fc147a06e8 could not be found. Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 06 04:56:49.693914 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e21191-04d9-45d3-9a4e-a7fc147a06e8 could not be found. Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e21191-04d9-45d3-9a4e-a7fc147a06e8 could not be found. Sep 06 04:56:49.695755 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: ERROR nova.api.openstack.wsgi Sep 06 04:56:49.697822 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: DEBUG nova.api.openstack.wsgi [None req-19083058-2a6e-4ae4-9f29-86a8946f0476 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] Returning 404 to user: Instance f5e21191-04d9-45d3-9a4e-a7fc147a06e8 could not be found. {{(pid=127618) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 06 04:56:49.697822 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: INFO nova.api.openstack.requestlog [None req-19083058-2a6e-4ae4-9f29-86a8946f0476 tempest-VolumesNegativeTest-2127341716 tempest-VolumesNegativeTest-2127341716-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8" status: 404 len: 111 microversion: 2.1 time: 0.031044 Sep 06 04:56:49.697822 dv-cinder-856002-1-iscsi devstack@n-api.service[127618]: [pid: 127618|app: 0|req: 700/1383] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Sep 6 04:56:49 2022] GET /compute/v2.1/servers/f5e21191-04d9-45d3-9a4e-a7fc147a06e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)